Sep 25 11:29:23 devstack cinder-volume[76113]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 11:29:23 devstack cinder-volume[76113]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 11:29:23 devstack cinder-volume[76113]: we strongly recommend against using it for new projects.
Sep 25 11:29:23 devstack cinder-volume[76113]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 11:29:23 devstack cinder-volume[76113]: framework.  For more detail see
Sep 25 11:29:23 devstack cinder-volume[76113]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 11:29:23 devstack cinder-volume[76113]:   import eventlet  # noqa
Sep 25 11:29:26 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:29:26 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:29:26 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:29:27 devstack cinder-volume[76113]: INFO dbcounter [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Registered counter for database cinder
Sep 25 11:29:27 devstack cinder-volume[76113]: DEBUG oslo_db.sqlalchemy.engines [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:29:28 devstack cinder-volume[76113]: DEBUG dbcounter [-] [76113] Writer thread running {{(pid=76113) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:29:28 devstack cinder-volume[76113]: INFO cinder.rpc [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 11:29:28 devstack cinder-volume[76113]: INFO cinder.rpc [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 11:29:28 devstack cinder-volume[76113]: DEBUG oslo_db.sqlalchemy.engines [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:29:28 devstack cinder-volume[76113]: INFO cinder.volume.manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Determined volume DB was empty at startup.
Sep 25 11:29:28 devstack cinder-volume[76113]: DEBUG cinder.volume.manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76113) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 11:29:28 devstack cinder-volume[76113]: INFO cinder.volume.manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 11:29:28 devstack cinder-volume[76113]: WARNING stevedore.named [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 11:29:28 devstack cinder-volume[76113]: WARNING castellan.key_manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:29:28 devstack cinder-volume[76113]: WARNING cinder.keymgr.conf_key_mgr [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:29:28 devstack cinder-volume[76113]: DEBUG cinder.volume.drivers.lvm [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76113) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 25 11:29:28 devstack cinder-volume[76113]: DEBUG oslo_concurrency.processutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76113) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_concurrency.processutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.488s {{(pid=76113) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_db.sqlalchemy.engines [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:29:29 devstack cinder-volume[76113]: INFO cinder.rpc [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 25 11:29:29 devstack cinder-volume[76113]: INFO cinder.rpc [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 25 11:29:29 devstack cinder-volume[76113]: WARNING stevedore.named [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 11:29:29 devstack cinder-volume[76113]: WARNING castellan.key_manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:29:29 devstack cinder-volume[76113]: INFO cinder.volume.manager [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_db.sqlalchemy.engines [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:29:29 devstack cinder-volume[76113]: INFO oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Starting 1 workers
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Started child 76312 {{(pid=76113) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Full set of CONF: {{(pid=76113) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] ******************************************************************************** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Configuration options gathered from: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] ================================================================================ {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] allow_availability_zone_fallback = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] allow_compression_on_image_upload = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] allowed_direct_url_schemes     = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76312]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] api_rate_limit                 = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] auth_strategy                  = keystone {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] az_cache_duration              = 3600 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_availability_zone      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_host                   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_name                   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_stats_polling_interval = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backup_api_class               = cinder.backup.api.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backup_name_template           = backup-%s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backup_use_same_host           = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backup_use_temp_snapshot       = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] chap_password                  = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] chap_username                  =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_internal_tenant_project_id = f5913f6ac8694f8cb249bde16cc966aa {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_internal_tenant_user_id = 9df50c1db5c64579842e60536bd87774 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cloned_volume_same_az          = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cluster                        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] compression_format             = gzip {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] config_dir                     = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] config_source                  = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] control_exchange               = openstack {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] debug                          = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] default_availability_zone      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] default_group_type             = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] default_volume_type            = lvmdriver-1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] disk_geometry                  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_client_cert             = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_client_cert_key         = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_data_namespace          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_ssl_cert_path           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_ssl_cert_verify         = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] driver_use_ssl                 = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] enable_force_upload            = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] enable_new_services            = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] enable_unsupported_driver      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] enforce_multipath_for_image_xfer = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] filter_function                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_api_insecure            = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_api_ssl_compression     = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_ca_certificates_file    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_certfile                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_keyfile                 = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_num_retries             = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance_request_timeout         = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] goodness_function              = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] graceful_shutdown_timeout      = 5 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] group_api_class                = cinder.group.api.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] host                           = devstack {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_compress_on_upload       = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_conversion_address_space_limit = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_conversion_cpu_limit     = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_conversion_disable       = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_introspection_address_space_limit = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_introspection_cpu_limit  = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_upload_use_cinder_backend = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_upload_use_internal_tenant = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_volume_cache_enabled     = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_volume_cache_max_count   = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] image_volume_cache_max_size_gb = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] init_host_max_objects_retrieval = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iscsi_target_flags             =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iscsi_write_cache              = on {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iser_helper                    = tgtadm {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iser_ip_address                = 192.168.122.129 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iser_port                      = 3260 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_color                      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_config_append              = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_dir                        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_file                       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_options                    = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_rotate_interval            = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_rotate_interval_type       = days {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] log_rotation_type              = none {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] max_age                        = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] max_logfile_count              = 30 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] max_logfile_size_mb            = 200 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] max_over_subscription_ratio    = 20.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] message_reap_interval          = 86400 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] message_ttl                    = 2592000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] migration_create_volume_timeout_secs = 300 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] monkey_patch                   = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] monkey_patch_modules           = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] my_ip                          = 192.168.122.129 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76312]: INFO cinder.volume.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] no_snapshot_gb_quota           = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] num_iser_scan_tries            = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] num_shell_tries                = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] num_volume_device_scan_tries   = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] nvmeof_conn_info_version       = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] nvmet_ns_id                    = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] nvmet_port_id                  = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_max_limit                = 1000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_ext_list          = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_listen_port       = 8776 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_use_ssl           = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] osapi_volume_workers           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] per_volume_size_limit          = -1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] periodic_fuzzy_delay           = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] periodic_interval              = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] public_endpoint                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] publish_errors                 = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_backup_gigabytes         = 1000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_backups                  = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_gigabytes                = 1000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_groups                   = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_snapshots                = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] quota_volumes                  = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] rate_limit_burst               = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] rate_limit_except_level        = CRITICAL {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] rate_limit_interval            = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] reinit_driver_count            = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] replication_device             = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] report_discard_supported       = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] report_interval                = 120 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] reservation_clean_interval     = 86400 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] reservation_expire             = 86400 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] reserved_image_namespaces      = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] reserved_percentage            = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] rpc_response_timeout           = 120 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] run_external_periodic_tasks    = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] scst_target_driver             = iscsi {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] scst_target_iqn_name           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_down_time              = 720 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] shell_completion               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] snapshot_name_template         = snapshot-%s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] snapshot_same_host             = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] split_loggers                  = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] state_path                     = /opt/stack/data/cinder {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] storage_availability_zone      = nova {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] storage_protocol               = iSCSI {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] syslog_log_facility            = LOG_USER {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_helper                  = lioadm {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_ip_address              = 192.168.122.129 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_port                    = 3260 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_protocol                = iscsi {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] target_secondary_ip_addresses  = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] trace_flags                    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] transport_url                  = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] until_refresh                  = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_chap_auth                  = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_default_quota_class        = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_journal                    = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_json                       = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_multipath_for_image_xfer   = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_stderr                     = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] use_syslog                     = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] verify_glance_signatures       = enabled {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_api_class               = cinder.volume.api.API {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_backend_name            = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_clear                   = zero {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_clear_ionice            = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_clear_size              = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_copy_bps_limit          = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_dd_blocksize            = 1M {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_name_template           = volume-%s {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_service_inithost_offload = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volume_usage_audit_period      = month {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] zoning_mode                    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_concurrency.disable_process_locking = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.auth_section = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.auth_type   = password {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.auth_version = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.cache       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.certfile    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.include_service_catalog = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.insecure    = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.interface   = public {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.keyfile     = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_password = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcache_username = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.region_name = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.service_type = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.backend                  = dogpile.cache.null {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.backend_argument         = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.backend_expiration_time  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.config_prefix            = cache.oslo {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.debug_cache_backend      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.enable_retry_client      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.enable_socket_keepalive  = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.enabled                  = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.expiration_time          = 600 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.hashclient_retry_attempts = 2 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_dead_retry      = 300 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_sasl_enabled    = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.password                 = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.proxies                  = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.redis_db                 = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.redis_server             = localhost:6379 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.retry_attempts           = 2 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.retry_delay              = 0.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.socket_keepalive_count   = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.socket_keepalive_idle    = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.socket_keepalive_interval = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.socket_timeout           = 1.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.tls_allowed_ciphers      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.tls_cafile               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.tls_certfile             = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.tls_enabled              = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.tls_keyfile              = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cache.username                 = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] coordination.backend_url       = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.asyncio_connection    = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.asyncio_slave_connection = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.backend               = sqlalchemy {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.connection            = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.connection_debug      = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.connection_parameters =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.connection_recycle_time = 3600 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.connection_trace      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.db_inc_retry_interval = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.db_max_retries        = 20 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.db_max_retry_interval = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.db_retry_interval     = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.max_overflow          = 50 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.max_pool_size         = 5 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.max_retries           = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.mysql_wsrep_sync_wait = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.pool_timeout          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.retry_interval        = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.slave_connection      = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.sqlite_synchronous    = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.synchronous_reader    = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] database.use_db_reconnect      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_tracing.insecure = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack sudo[76362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.connection_string     = messaging:// {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.enabled               = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.es_doc_type           = notification {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.es_scroll_size        = 10000 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.es_scroll_time        = 2m {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.filter_error_trace    = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.hmac_keys             = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.sentinel_service_name = mymaster {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.socket_timeout        = 0.1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.trace_requests        = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler.trace_sqlalchemy      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler_jaeger.process_tags   = {} {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler_jaeger.service_name_prefix = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] profiler_otlp.service_name_prefix = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.enforce_new_defaults = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.policy_default_rule = default {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.group          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.helper_command = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] privsep_osbrick.user           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.group         = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.helper_command = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] cinder_sys_admin.user          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.auth_section      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.auth_type         = password {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.cafile            = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.certfile          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.collect_timing    = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.insecure          = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.keyfile           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.send_service_user_token = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.split_loggers     = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.timeout           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.tls_ciphers       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] service_user.tls_min_version   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.auth_section            = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.auth_type               = password {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.certfile                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.collect_timing          = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.insecure                = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.keyfile                 = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.region_name             = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.split_loggers           = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.timeout                 = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.tls_ciphers             = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] glance.tls_min_version         = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.backend_availability_zone = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.chap_password = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.chap_username =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.disk_geometry = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_client_cert = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_client_cert_key = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_data_namespace = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.driver_use_ssl = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.extra_capabilities = {} {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.filter_function = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.goodness_function = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iscsi_target_flags =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iscsi_write_cache = on {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iser_port     = 3260 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.lvm_share_target = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.lvm_type      = auto {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.num_shell_tries = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.replication_device = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.report_discard_supported = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.reserved_percentage = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_helper = tgtadm {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_port   = 3260 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_protocol = iscsi {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.trace_flags   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.unique_fqdn_network = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.use_chap_auth = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_backend_name = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_clear  = zero {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_clear_ionice = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_clear_size = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_reports.file_event_handler = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_reports.log_dir           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.backend_host       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.chap_password      = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.chap_username      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.disk_geometry      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_client_cert = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.extra_capabilities = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.filter_function    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.goodness_function  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iser_helper        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iser_port          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.lvm_type           = auto {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.replication_device = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.report_discard_supported = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.reserved_percentage = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.scst_target_driver = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.storage_protocol   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_ip_address  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_port        = 3260 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.trace_flags        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_clear       = zero {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] lvmdriver-1.volumes_dir        = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_notifications.driver = [] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_notifications.retry = -1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] key_manager.fixed_key          = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.barbican_api_version  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.barbican_endpoint     = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.barbican_endpoint_type = public {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.barbican_region_name  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.cafile                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.certfile              = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.collect_timing        = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.insecure              = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.keyfile               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.number_of_retries     = 60 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.retry_delay           = 1 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.send_service_user_token = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.split_loggers         = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.timeout               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.tls_ciphers           = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.tls_min_version       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.verify_ssl            = True {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican.verify_ssl_path       = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.auth_section = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.auth_type = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.cafile   = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.certfile = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.collect_timing = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.insecure = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.keyfile  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.split_loggers = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.timeout  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.tls_ciphers = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] barbican_service_user.tls_min_version = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.approle_role_id          = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.approle_secret_id        = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.auth_method              = approle {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.auth_path                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.kv_mountpoint            = secret {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.kv_path                  = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.kv_version               = 2 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.namespace                = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.root_token_id            = **** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.ssl_ca_crt_file          = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.timeout                  = 60.0 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.token_file               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.token_role               = None {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.use_ssl                  = False {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:29:29 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] ******************************************************************************** {{(pid=76113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 11:29:29 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:29 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:29 devstack sudo[76490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:29 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:30 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.307s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:29:30 devstack cinder-volume[76312]: INFO cinder.brick.local_dev.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:30 devstack sudo[76602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:30 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:30 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG cinder.brick.local_dev.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76312) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 25 11:29:30 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:30 devstack sudo[76711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:30 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:31 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.949s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:31 devstack sudo[76960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:31 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:31 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.340s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:31 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:31 devstack sudo[76991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 25 11:29:31 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:32 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.328s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:32 devstack sudo[77050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:32 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:32 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:32 devstack sudo[77089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:32 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:32 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:32 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:32 devstack sudo[77092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:32 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:33 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack sudo[77095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:33 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:33 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack sudo[77099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:33 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:33 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: INFO cinder.volume.drivers.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack sudo[77103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:33 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:33 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:29:33 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:33 devstack sudo[77113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:33 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:34 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:34 devstack sudo[77117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:34 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:34 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:34 devstack sudo[77122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:34 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:34 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:34 devstack sudo[77125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:34 devstack sudo[77125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:34 devstack sudo[77125]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:34 devstack cinder-volume[76312]: INFO cinder.volume.driver [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 11:29:34 devstack cinder-volume[76312]: DEBUG cinder.volume.driver [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76312) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_db.sqlalchemy.engines [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writer thread running {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG cinder.db.api [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Building query based on filter {{(pid=76312) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG cinder.image.image_utils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76312) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 11:29:35 devstack cinder-volume[76312]: INFO cinder.keymgr.migration [None req-d3879b6b-ca62-4fe6-b35b-4e2d81860a1c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:35 devstack sudo[77128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:35 devstack sudo[77128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:35 devstack sudo[77128]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:35 devstack sudo[77131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:35 devstack sudo[77131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:35 devstack sudo[77131]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:35 devstack sudo[77134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:35 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:35 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:35 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:35 devstack sudo[77139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:35 devstack sudo[77139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:36 devstack sudo[77139]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG cinder.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Notifying Schedulers of capabilities ... {{(pid=76312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:29:36 devstack cinder-volume[76312]: INFO cinder.volume.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Driver initialization completed successfully.
Sep 25 11:29:36 devstack cinder-volume[76312]: INFO cinder.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Initiating service 2 cleanup
Sep 25 11:29:36 devstack cinder-volume[76312]: INFO cinder.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Service 2 cleanup completed.
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG cinder.service [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Creating RPC server for service cinder-volume {{(pid=76312) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG cinder.service [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76312) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 11:29:36 devstack cinder-volume[76312]: INFO cinder.volume.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:36 devstack sudo[77143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:29:36 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:36 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:36 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:36 devstack sudo[77146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:36 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:37 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:37 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:37 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:37 devstack sudo[77152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:29:37 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:37 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:37 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:37 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:29:37 devstack sudo[77155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:29:37 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:29:37 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root
Sep 25 11:29:37 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:29:37 devstack cinder-volume[76312]: INFO cinder.volume.manager [None req-d047f5e3-dd42-4c13-98bb-bc5966aa9768 None None] Driver post RPC initialization completed successfully.
Sep 25 11:29:39 devstack cinder-volume[76113]: DEBUG dbcounter [-] [76113] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76113) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:29:44 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager._thread_info {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:29:44 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread count: 6 {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:29:44 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread info: [<_MainThread(MainThread, started 126580816183424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126580701691584)>, <Thread(Thread-3 (stat_writer), started daemon 126580702059392)>, <Thread(Rabbit-heartbeat, started daemon 126580701189888)>, <Thread(Thread-5 (_runner), started daemon 126580699517248)>, <Thread(Thread-7 (_runner), started daemon 126580699662592)>] {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:29:47 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writing DB stats cinder:SELECT=4 {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:29:47 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:30:44 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:30:44 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:30:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:30:44 devstack sudo[79206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:30:44 devstack sudo[79206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:30:44 devstack sudo[79206]: pam_unix(sudo:session): session closed for user root
Sep 25 11:30:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:30:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:30:44 devstack sudo[79209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:30:44 devstack sudo[79209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:30:45 devstack sudo[79209]: pam_unix(sudo:session): session closed for user root
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:30:45 devstack sudo[79212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:30:45 devstack sudo[79212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:30:45 devstack sudo[79212]: pam_unix(sudo:session): session closed for user root
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:30:45 devstack sudo[79233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:30:45 devstack sudo[79233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:30:45 devstack sudo[79233]: pam_unix(sudo:session): session closed for user root
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG cinder.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Notifying Schedulers of capabilities ... {{(pid=76312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager._thread_info {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread count: 6 {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:30:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread info: [<_MainThread(MainThread, started 126580816183424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126580701691584)>, <Thread(Thread-3 (stat_writer), started daemon 126580702059392)>, <Thread(Rabbit-heartbeat, started daemon 126580701189888)>, <Thread(Thread-5 (_runner), started daemon 126580699517248)>, <Thread(Thread-7 (_runner), started daemon 126580699662592)>] {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:31:44 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:31:44 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:31:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:31:44 devstack sudo[82543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:31:44 devstack sudo[82543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:31:44 devstack sudo[82543]: pam_unix(sudo:session): session closed for user root
Sep 25 11:31:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:31:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:31:44 devstack sudo[82546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:31:44 devstack sudo[82546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:31:45 devstack sudo[82546]: pam_unix(sudo:session): session closed for user root
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:31:45 devstack sudo[82565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:31:45 devstack sudo[82565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:31:45 devstack sudo[82565]: pam_unix(sudo:session): session closed for user root
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:31:45 devstack sudo[82569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:31:45 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:31:45 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG cinder.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Notifying Schedulers of capabilities ... {{(pid=76312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager._thread_info {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread count: 6 {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:31:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread info: [<_MainThread(MainThread, started 126580816183424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126580701691584)>, <Thread(Thread-3 (stat_writer), started daemon 126580702059392)>, <Thread(Rabbit-heartbeat, started daemon 126580701189888)>, <Thread(Thread-5 (_runner), started daemon 126580699517248)>, <Thread(Thread-7 (_runner), started daemon 126580699662592)>] {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:31:47 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:32:44 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:32:44 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:32:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:32:44 devstack sudo[84565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:32:44 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:32:44 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root
Sep 25 11:32:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:32:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:32:44 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:32:44 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:32:45 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:32:45 devstack sudo[84576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:32:45 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:32:45 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:32:45 devstack sudo[84582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:32:45 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:32:45 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG cinder.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Notifying Schedulers of capabilities ... {{(pid=76312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager._thread_info {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread count: 6 {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:32:45 devstack cinder-volume[76312]: DEBUG cinder.volume.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] thread info: [<_MainThread(MainThread, started 126580816183424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126580701691584)>, <Thread(Thread-3 (stat_writer), started daemon 126580702059392)>, <Thread(Rabbit-heartbeat, started daemon 126580701189888)>, <Thread(Thread-5 (_runner), started daemon 126580699517248)>, <Thread(Thread-7 (_runner), started daemon 126580699662592)>] {{(pid=76312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:33:44 devstack cinder-volume[76312]: DEBUG oslo_service.periodic_task [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:33:44 devstack cinder-volume[76312]: DEBUG cinder.volume.drivers.lvm [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Updating volume stats {{(pid=76312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 11:33:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:33:44 devstack sudo[85722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 11:33:44 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:33:44 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root
Sep 25 11:33:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:33:44 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:33:44 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:33:44 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:33:45 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:33:45 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 11:33:45 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:33:45 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:33:45 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 11:33:45 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:33:45 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG oslo_concurrency.processutils [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:33:45 devstack cinder-volume[76312]: DEBUG cinder.manager [None req-e8d8c2bf-cd68-407f-a88c-08183e107c54 None None] Notifying Schedulers of capabilities ... {{(pid=76312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:33:47 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writing DB stats cinder:SELECT=1 {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:33:47 devstack cinder-volume[76312]: DEBUG dbcounter [-] [76312] Writing DB stats cinder:UPDATE=1 {{(pid=76312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:07 devstack cinder-volume[76113]: INFO oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Caught SIGTERM, stopping children
Sep 25 11:34:07 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Acquiring lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:07 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Acquired lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:07 devstack cinder-volume[76113]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Releasing lock "singleton_lock" {{(pid=76113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:07 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Stop services. {{(pid=76113) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 11:34:07 devstack cinder-volume[76113]: DEBUG oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Killing children. {{(pid=76113) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 11:34:07 devstack cinder-volume[76113]: INFO oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Waiting on 1 children to exit
Sep 25 11:34:11 devstack cinder-volume[76312]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Acquiring lock "singleton_lock" {{(pid=76312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:11 devstack cinder-volume[76312]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Acquired lock "singleton_lock" {{(pid=76312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:11 devstack cinder-volume[76312]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Releasing lock "singleton_lock" {{(pid=76312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:11 devstack cinder-volume[76312]: WARNING amqp [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 11:34:11 devstack cinder-volume[76312]: WARNING amqp [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 11:34:11 devstack cinder-volume[76113]: INFO oslo_service.backend._eventlet.service [None req-5a1c8fe2-2f48-40c2-be98-4ad4de823ef5 None None] Child 76312 exited with status 0
Sep 25 11:34:11 devstack cinder-volume[86301]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 11:34:11 devstack cinder-volume[86301]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 11:34:11 devstack cinder-volume[86301]: we strongly recommend against using it for new projects.
Sep 25 11:34:11 devstack cinder-volume[86301]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 11:34:11 devstack cinder-volume[86301]: framework.  For more detail see
Sep 25 11:34:11 devstack cinder-volume[86301]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 11:34:11 devstack cinder-volume[86301]:   import eventlet  # noqa
Sep 25 11:34:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:14 devstack cinder-volume[86301]: INFO dbcounter [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Registered counter for database cinder
Sep 25 11:34:14 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writer thread running {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO cinder.rpc [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO cinder.rpc [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Determined volume DB was empty at startup.
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86301) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 11:34:15 devstack cinder-volume[86301]: WARNING stevedore.named [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 11:34:15 devstack cinder-volume[86301]: WARNING castellan.key_manager [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:34:15 devstack cinder-volume[86301]: WARNING cinder.keymgr.conf_key_mgr [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:15 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Starting 1 workers
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Started child 86520 {{(pid=86301) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Full set of CONF: {{(pid=86301) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Configuration options gathered from: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] ================================================================================ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 11:34:15 devstack cinder-volume[86520]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] allow_availability_zone_fallback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] allow_compression_on_image_upload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] allowed_direct_url_schemes     = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] api_rate_limit                 = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] auth_strategy                  = keystone {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_availability_zone      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_host                   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_name                   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_stats_polling_interval = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backup_api_class               = cinder.backup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backup_name_template           = backup-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backup_use_same_host           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backup_use_temp_snapshot       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] chap_password                  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] chap_username                  =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_internal_tenant_project_id = f5913f6ac8694f8cb249bde16cc966aa {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_internal_tenant_user_id = 9df50c1db5c64579842e60536bd87774 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cluster                        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] compression_format             = gzip {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] config_dir                     = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] config_source                  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] control_exchange               = openstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] debug                          = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] default_availability_zone      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] default_group_type             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] default_volume_type            = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] disk_geometry                  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_client_cert             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_client_cert_key         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_data_namespace          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_ssl_cert_path           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_ssl_cert_verify         = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] driver_use_ssl                 = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] enable_new_services            = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] enable_unsupported_driver      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] filter_function                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_api_insecure            = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_api_ssl_compression     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_ca_certificates_file    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_certfile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_keyfile                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_num_retries             = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance_request_timeout         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] goodness_function              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] graceful_shutdown_timeout      = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] group_api_class                = cinder.group.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] host                           = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_compress_on_upload       = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_conversion_address_space_limit = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_conversion_cpu_limit     = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_conversion_disable       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_introspection_address_space_limit = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_introspection_cpu_limit  = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_volume_cache_enabled     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_volume_cache_max_count   = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] init_host_max_objects_retrieval = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iscsi_target_flags             =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iscsi_write_cache              = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iser_helper                    = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iser_ip_address                = 192.168.122.129 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iser_port                      = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_color                      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_config_append              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_dir                        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_file                       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_options                    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_rotate_interval            = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_rotate_interval_type       = days {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] log_rotation_type              = none {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] max_age                        = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] max_logfile_count              = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] max_logfile_size_mb            = 200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] max_over_subscription_ratio    = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] message_reap_interval          = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] message_ttl                    = 2592000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] migration_create_volume_timeout_secs = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] monkey_patch                   = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] monkey_patch_modules           = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] my_ip                          = 192.168.122.129 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] no_snapshot_gb_quota           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] num_iser_scan_tries            = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] num_shell_tries                = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] num_volume_device_scan_tries   = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] nvmeof_conn_info_version       = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] nvmet_ns_id                    = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] nvmet_port_id                  = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_max_limit                = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_ext_list          = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_listen_port       = 8776 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_use_ssl           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] osapi_volume_workers           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] per_volume_size_limit          = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] periodic_fuzzy_delay           = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] periodic_interval              = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] public_endpoint                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] publish_errors                 = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_backup_gigabytes         = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_backups                  = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_gigabytes                = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_groups                   = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_snapshots                = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] quota_volumes                  = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] rate_limit_burst               = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] rate_limit_except_level        = CRITICAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] rate_limit_interval            = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] reinit_driver_count            = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] replication_device             = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] report_discard_supported       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] report_interval                = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] reservation_clean_interval     = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] reservation_expire             = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] reserved_image_namespaces      = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] reserved_percentage            = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] rpc_response_timeout           = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] run_external_periodic_tasks    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] scst_target_driver             = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] scst_target_iqn_name           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_down_time              = 720 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] shell_completion               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] snapshot_name_template         = snapshot-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] split_loggers                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] state_path                     = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] storage_availability_zone      = nova {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] storage_protocol               = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] syslog_log_facility            = LOG_USER {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_helper                  = lioadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_ip_address              = 192.168.122.129 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_port                    = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_protocol                = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] target_secondary_ip_addresses  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] trace_flags                    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] transport_url                  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] until_refresh                  = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_chap_auth                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_default_quota_class        = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_journal                    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_json                       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_multipath_for_image_xfer   = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_stderr                     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] use_syslog                     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] verify_glance_signatures       = enabled {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_api_class               = cinder.volume.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_backend_name            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_clear                   = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_clear_ionice            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_clear_size              = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_copy_bps_limit          = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_dd_blocksize            = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_name_template           = volume-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_service_inithost_offload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volume_usage_audit_period      = month {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] zoning_mode                    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_concurrency.disable_process_locking = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.auth_type   = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.auth_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.cache       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.certfile    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.include_service_catalog = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.insecure    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.interface   = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.keyfile     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcache_username = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.region_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.service_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.backend                  = dogpile.cache.null {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.backend_argument         = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.backend_expiration_time  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.config_prefix            = cache.oslo {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.debug_cache_backend      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.enable_retry_client      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.enable_socket_keepalive  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.enabled                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.expiration_time          = 600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.hashclient_retry_attempts = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_dead_retry      = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_sasl_enabled    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.password                 = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.proxies                  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.redis_db                 = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.redis_server             = localhost:6379 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.retry_attempts           = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.retry_delay              = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.socket_keepalive_count   = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.socket_keepalive_idle    = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.socket_keepalive_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.socket_timeout           = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.tls_allowed_ciphers      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.tls_cafile               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.tls_certfile             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.tls_enabled              = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.tls_keyfile              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cache.username                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] coordination.backend_url       = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.asyncio_connection    = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.asyncio_slave_connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.backend               = sqlalchemy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.connection            = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86520]: INFO cinder.volume.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.connection_debug      = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.remotefs [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86520) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.connection_parameters =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.connection_recycle_time = 3600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.connection_trace      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.db_inc_retry_interval = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.db_max_retries        = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.db_max_retry_interval = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.db_retry_interval     = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.max_overflow          = 50 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.max_pool_size         = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.max_retries           = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.mysql_wsrep_sync_wait = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.pool_timeout          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.retry_interval        = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.slave_connection      = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.sqlite_synchronous    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.synchronous_reader    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] database.use_db_reconnect      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_tracing.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.connection_string     = messaging:// {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.enabled               = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.es_doc_type           = notification {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.es_scroll_size        = 10000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.es_scroll_time        = 2m {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.filter_error_trace    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.hmac_keys             = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.socket_timeout        = 0.1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.trace_requests        = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler.trace_sqlalchemy      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler_jaeger.process_tags   = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler_jaeger.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] profiler_otlp.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.enforce_new_defaults = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.policy_default_rule = default {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.group          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] privsep_osbrick.user           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.group         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] cinder_sys_admin.user          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.auth_section      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.auth_type         = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.cafile            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.certfile          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.collect_timing    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.insecure          = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.keyfile           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.send_service_user_token = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.split_loggers     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.timeout           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.tls_ciphers       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] service_user.tls_min_version   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.auth_section            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.auth_type               = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.certfile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.collect_timing          = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.insecure                = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.keyfile                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.region_name             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.split_loggers           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.timeout                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.tls_ciphers             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] glance.tls_min_version         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.chap_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.chap_username =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.disk_geometry = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_client_cert = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.driver_use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.extra_capabilities = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.filter_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.goodness_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iscsi_target_flags =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iscsi_write_cache = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iser_port     = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_host      =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_login     = admin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_mount_options = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_password  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_private_key =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_share_path =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.num_shell_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.quobyte_volume_url = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.replication_device = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.report_discard_supported = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.reserved_percentage = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_helper = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_port   = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_protocol = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.trace_flags   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.unique_fqdn_network = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.use_chap_auth = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_backend_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_clear  = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_clear_ionice = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_clear_size = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_reports.file_event_handler = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_reports.log_dir           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.backend_host         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.chap_password        = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.chap_username        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.disk_geometry        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_client_cert   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.extra_capabilities   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.filter_function      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.goodness_function    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iser_helper          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iser_ip_address      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iser_port            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_host             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_login            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_mount_options    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_password         = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_private_key      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_share_path       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.num_shell_tries      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.replication_device   = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.report_discard_supported = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.reserved_percentage  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.scst_target_driver   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.storage_protocol     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_helper        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_ip_address    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_port          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:15 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_prefix        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_protocol      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.trace_flags          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.use_chap_auth        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_clear         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_clear_size    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] QuobyteHD.volumes_dir          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_notifications.driver = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_notifications.retry = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] key_manager.fixed_key          = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.barbican_api_version  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.barbican_endpoint     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.barbican_endpoint_type = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.barbican_region_name  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.cafile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.certfile              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.collect_timing        = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.insecure              = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.keyfile               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.number_of_retries     = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.retry_delay           = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.send_service_user_token = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.split_loggers         = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.timeout               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.tls_ciphers           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.tls_min_version       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.verify_ssl            = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican.verify_ssl_path       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.auth_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.cafile   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.keyfile  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.timeout  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.tls_ciphers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] barbican_service_user.tls_min_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.approle_role_id          = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.approle_secret_id        = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.auth_method              = approle {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.auth_path                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.kv_mountpoint            = secret {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.kv_path                  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.kv_version               = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.namespace                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.root_token_id            = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.ssl_ca_crt_file          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.timeout                  = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.token_file               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.token_role               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.use_ssl                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:16 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86520) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 11:34:16 devstack cinder-volume[86520]: WARNING cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 11:34:16 devstack cinder-volume[86520]: WARNING cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=86520) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:16 devstack cinder-volume[86520]: INFO cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 ...
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f -c /etc/quobyte/client-cinder.cfg {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:16 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f -c /etc/quobyte/client-cinder.cfg
Sep 25 11:34:16 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:16 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.460s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:16 devstack cinder-volume[86520]: INFO cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 succeeded
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=86520) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.478s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:16 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:16 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:16 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.245s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:16 devstack cinder-volume[86520]: INFO cinder.volume.driver [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.volume.driver [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86520) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_db.sqlalchemy.engines [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86520) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG dbcounter [-] [86520] Writer thread running {{(pid=86520) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.db.api [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Building query based on filter {{(pid=86520) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.image.image_utils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86520) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 11:34:16 devstack cinder-volume[86520]: INFO cinder.keymgr.migration [None req-7b6173ab-468a-4606-b72a-b9a85a9c5a80 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:16 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=86520) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=86520) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:17 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:17 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:17 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.248s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Notifying Schedulers of capabilities ... {{(pid=86520) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:34:17 devstack cinder-volume[86520]: INFO cinder.volume.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Driver initialization completed successfully.
Sep 25 11:34:17 devstack cinder-volume[86520]: INFO cinder.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Initiating service 3 cleanup
Sep 25 11:34:17 devstack cinder-volume[86520]: INFO cinder.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Service 3 cleanup completed.
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.service [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Creating RPC server for service cinder-volume {{(pid=86520) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.service [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86520) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 11:34:17 devstack cinder-volume[86520]: INFO cinder.volume.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=86520) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=86520) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:17 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:17 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:17 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:17 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.310s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:17 devstack cinder-volume[86520]: INFO cinder.volume.manager [None req-1a585ec0-f695-450b-adc4-44d75dc8f3a7 None None] Driver post RPC initialization completed successfully.
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=86520) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG cinder.volume.drivers.quobyte [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=86520) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86520) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:22 devstack sudo[86862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:22 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:22 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG oslo_concurrency.processutils [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.238s {{(pid=86520) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:22 devstack cinder-volume[86520]: DEBUG cinder.manager [None req-c285f001-5ebf-4f73-9b9b-df2d8cf5784c None None] Notifying Schedulers of capabilities ... {{(pid=86520) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:34:24 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Caught SIGTERM, stopping children
Sep 25 11:34:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Acquiring lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Acquired lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Releasing lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:24 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Stop services. {{(pid=86301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 11:34:24 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Killing children. {{(pid=86301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 11:34:24 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Waiting on 1 children to exit
Sep 25 11:34:26 devstack cinder-volume[86520]: DEBUG oslo_service.periodic_task [None req-02c26136-8860-4ed7-b964-81b0b00f573a None None] Running periodic task VolumeManager._thread_info {{(pid=86520) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:34:26 devstack cinder-volume[86520]: DEBUG cinder.volume.manager [None req-02c26136-8860-4ed7-b964-81b0b00f573a None None] thread count: 6 {{(pid=86520) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:34:26 devstack cinder-volume[86520]: DEBUG cinder.volume.manager [None req-02c26136-8860-4ed7-b964-81b0b00f573a None None] thread info: [<_MainThread(MainThread, started 138033916608640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138033816398336)>, <Thread(Thread-3 (stat_writer), started daemon 138033804450368)>, <Thread(Rabbit-heartbeat, started daemon 138033802618112)>, <Thread(Thread-7 (_runner), started daemon 138033800381568)>, <Thread(Thread-4 (_process_in_background), started daemon 138033817477760)>] {{(pid=86520) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:34:27 devstack cinder-volume[86520]: DEBUG dbcounter [-] [86520] Writing DB stats cinder:SELECT=4 {{(pid=86520) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:27 devstack cinder-volume[86520]: DEBUG dbcounter [-] [86520] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86520) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:29 devstack cinder-volume[86520]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 25 11:34:30 devstack cinder-volume[87062]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 11:34:30 devstack cinder-volume[87062]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 11:34:30 devstack cinder-volume[87062]: we strongly recommend against using it for new projects.
Sep 25 11:34:30 devstack cinder-volume[87062]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 11:34:30 devstack cinder-volume[87062]: framework.  For more detail see
Sep 25 11:34:30 devstack cinder-volume[87062]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 11:34:30 devstack cinder-volume[87062]:   import eventlet  # noqa
Sep 25 11:34:30 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Acquiring lock "singleton_lock" {{(pid=86520) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:30 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Acquired lock "singleton_lock" {{(pid=86520) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:30 devstack cinder-volume[86520]: DEBUG oslo_concurrency.lockutils [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Releasing lock "singleton_lock" {{(pid=86520) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:30 devstack cinder-volume[86520]: WARNING amqp [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 11:34:30 devstack cinder-volume[86520]: WARNING amqp [None req-e9d569d6-2461-420a-bbc9-fd4882957578 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 11:34:33 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 11:34:33 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 11:34:33 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO dbcounter [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Registered counter for database cinder
Sep 25 11:34:34 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:34 devstack cinder-volume[87062]: DEBUG dbcounter [-] [87062] Writer thread running {{(pid=87062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO cinder.rpc [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO cinder.rpc [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 11:34:34 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO cinder.volume.manager [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Determined volume DB was empty at startup.
Sep 25 11:34:34 devstack cinder-volume[87062]: DEBUG cinder.volume.manager [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87062) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 11:34:34 devstack cinder-volume[87062]: WARNING stevedore.named [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 11:34:34 devstack cinder-volume[87062]: WARNING castellan.key_manager [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:34:34 devstack cinder-volume[87062]: WARNING cinder.keymgr.conf_key_mgr [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO cinder.volume.manager [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 11:34:34 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:34 devstack cinder-volume[87062]: INFO oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Starting 1 workers
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Started child 87358 {{(pid=87062) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Full set of CONF: {{(pid=87062) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] ******************************************************************************** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] Configuration options gathered from: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] ================================================================================ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] allow_availability_zone_fallback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] allow_compression_on_image_upload = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] allowed_direct_url_schemes     = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] api_rate_limit                 = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] auth_strategy                  = keystone {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_availability_zone      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_host                   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_name                   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_stats_polling_interval = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backup_api_class               = cinder.backup.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backup_name_template           = backup-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backup_use_same_host           = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backup_use_temp_snapshot       = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] chap_password                  = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] chap_username                  =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_internal_tenant_project_id = f5913f6ac8694f8cb249bde16cc966aa {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_internal_tenant_user_id = 9df50c1db5c64579842e60536bd87774 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cluster                        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] compression_format             = gzip {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] compute_api_class              = cinder.compute.nova.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] config_dir                     = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] config_source                  = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] control_exchange               = openstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] debug                          = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] default_availability_zone      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] default_group_type             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] default_volume_type            = QuobyteHD {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] disk_geometry                  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_client_cert             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_client_cert_key         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_data_namespace          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_ssl_cert_path           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_ssl_cert_verify         = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] driver_use_ssl                 = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] enable_new_services            = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] enable_unsupported_driver      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] enabled_backends               = ['QuobyteHD'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] enforce_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] filter_function                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_api_insecure            = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_api_ssl_compression     = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_ca_certificates_file    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_catalog_info            = image:glance:publicURL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_certfile                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_keyfile                 = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_num_retries             = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance_request_timeout         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] goodness_function              = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] graceful_shutdown_timeout      = 5 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] group_api_class                = cinder.group.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] host                           = devstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_compress_on_upload       = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_conversion_address_space_limit = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_conversion_cpu_limit     = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_conversion_disable       = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_introspection_address_space_limit = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_introspection_cpu_limit  = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_upload_use_cinder_backend = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_upload_use_internal_tenant = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_volume_cache_enabled     = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_volume_cache_max_count   = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] image_volume_cache_max_size_gb = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] init_host_max_objects_retrieval = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] instance_format                = [instance: %(uuid)s]  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iscsi_target_flags             =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iscsi_write_cache              = on {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iser_helper                    = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iser_ip_address                = 192.168.122.129 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iser_port                      = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_color                      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_config_append              = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_dir                        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_file                       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_options                    = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_rotate_interval            = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_rotate_interval_type       = days {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] log_rotation_type              = none {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87358) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] max_age                        = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] max_logfile_count              = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] max_logfile_size_mb            = 200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] max_over_subscription_ratio    = 20.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] message_reap_interval          = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] message_ttl                    = 2592000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] migration_create_volume_timeout_secs = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] monkey_patch                   = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] monkey_patch_modules           = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] my_ip                          = 192.168.122.129 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] no_snapshot_gb_quota           = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] num_iser_scan_tries            = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] num_shell_tries                = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] num_volume_device_scan_tries   = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] nvmeof_conn_info_version       = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] nvmet_ns_id                    = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] nvmet_port_id                  = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_max_limit                = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_ext_list          = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_listen_port       = 8776 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_use_ssl           = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] osapi_volume_workers           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] per_volume_size_limit          = -1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] periodic_fuzzy_delay           = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] periodic_interval              = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] public_endpoint                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] publish_errors                 = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_backup_gigabytes         = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_backups                  = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_gigabytes                = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_groups                   = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_snapshots                = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] quota_volumes                  = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] rate_limit_burst               = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] rate_limit_except_level        = CRITICAL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] rate_limit_interval            = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] reinit_driver_count            = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] replication_device             = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] report_discard_supported       = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] report_interval                = 120 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] reservation_clean_interval     = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] reservation_expire             = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] reserved_image_namespaces      = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] reserved_percentage            = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] rpc_response_timeout           = 120 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] run_external_periodic_tasks    = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] scst_target_driver             = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] scst_target_iqn_name           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_down_time              = 720 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] shell_completion               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] snapshot_name_template         = snapshot-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] split_loggers                  = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] state_path                     = /opt/stack/data/cinder {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] storage_availability_zone      = nova {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] storage_protocol               = iSCSI {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] syslog_log_facility            = LOG_USER {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_helper                  = lioadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_ip_address              = 192.168.122.129 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_port                    = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_protocol                = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] target_secondary_ip_addresses  = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] trace_flags                    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] transport_url                  = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] until_refresh                  = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_chap_auth                  = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_default_quota_class        = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_journal                    = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_json                       = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_multipath_for_image_xfer   = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_stderr                     = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] use_syslog                     = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] verify_glance_signatures       = enabled {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_api_class               = cinder.volume.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_backend_name            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_clear                   = zero {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_clear_ionice            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_clear_size              = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_copy_bps_limit          = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_dd_blocksize            = 1M {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_name_template           = volume-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_service_inithost_offload = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volume_usage_audit_period      = month {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] zoning_mode                    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_concurrency.disable_process_locking = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.auth_type   = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.auth_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.cache       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.certfile    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.include_service_catalog = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.insecure    = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.interface   = public {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.keyfile     = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87358) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 11:34:35 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcache_username = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.region_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.service_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Running cmd (subprocess): mount.quobyte {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.backend                  = dogpile.cache.null {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.backend_argument         = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.backend_expiration_time  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.config_prefix            = cache.oslo {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.debug_cache_backend      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.enable_retry_client      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.enable_socket_keepalive  = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.enabled                  = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.expiration_time          = 600 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.hashclient_retry_attempts = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_dead_retry      = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_pool_maxsize    = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_sasl_enabled    = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.password                 = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.proxies                  = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.redis_db                 = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.redis_server             = localhost:6379 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.retry_attempts           = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.retry_delay              = 0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.socket_keepalive_count   = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.socket_keepalive_idle    = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.socket_keepalive_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.socket_timeout           = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.tls_allowed_ciphers      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.tls_cafile               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.tls_certfile             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.tls_enabled              = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.tls_keyfile              = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cache.username                 = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] coordination.backend_url       = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.asyncio_connection    = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.asyncio_slave_connection = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.backend               = sqlalchemy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.connection            = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.connection_debug      = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.connection_parameters =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.connection_recycle_time = 3600 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.connection_trace      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.db_inc_retry_interval = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.db_max_retries        = 20 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.db_max_retry_interval = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.db_retry_interval     = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.max_overflow          = 50 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.max_pool_size         = 5 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.max_retries           = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.mysql_wsrep_sync_wait = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.pool_timeout          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.retry_interval        = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.slave_connection      = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.sqlite_synchronous    = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.synchronous_reader    = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] database.use_db_reconnect      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_tracing.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.connection_string     = messaging:// {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.enabled               = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.es_doc_type           = notification {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.es_scroll_size        = 10000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.es_scroll_time        = 2m {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.filter_error_trace    = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.hmac_keys             = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.sentinel_service_name = mymaster {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.socket_timeout        = 0.1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.trace_requests        = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler.trace_sqlalchemy      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler_jaeger.process_tags   = {} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler_jaeger.service_name_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] profiler_otlp.service_name_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.enforce_new_defaults = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.policy_default_rule = default {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.policy_file        = policy.yaml {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.group          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.helper_command = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] privsep_osbrick.user           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.group         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.helper_command = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] cinder_sys_admin.user          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.auth_section      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.auth_type         = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.cafile            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.certfile          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.collect_timing    = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.insecure          = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.keyfile           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.send_service_user_token = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.split_loggers     = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.timeout           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.tls_ciphers       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] service_user.tls_min_version   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.auth_section            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.auth_type               = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.certfile                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.collect_timing          = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.insecure                = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.keyfile                 = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.region_name             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack quobyte-client[87359]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 11:34:35 devstack quobyte-client[87359]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.split_loggers           = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.timeout                 = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.tls_ciphers             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] glance.tls_min_version         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.backend_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.chap_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.chap_username =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.disk_geometry = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_client_cert = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_client_cert_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_data_namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.driver_use_ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.extra_capabilities = {} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.filter_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.goodness_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iscsi_target_flags =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iscsi_write_cache = on {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iser_helper   = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iser_port     = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_host      =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_login     = admin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_mount_options = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_password  = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_private_key =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_share_path =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.num_shell_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.quobyte_volume_url = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.replication_device = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.report_discard_supported = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.reserved_percentage = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_helper = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_port   = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_protocol = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.trace_flags   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.unique_fqdn_network = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.use_chap_auth = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_backend_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_clear  = zero {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_clear_ionice = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_clear_size = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_reports.file_event_handler = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_reports.log_dir           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.backend_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.backend_host         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.chap_password        = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.chap_username        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.chiscsi_conf         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.disk_geometry        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_client_cert   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_data_namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.driver_use_ssl       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.extra_capabilities   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.filter_function      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.goodness_function    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iser_helper          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iser_ip_address      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iser_port            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.iser_target_prefix   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_host             = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_login            = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_mount_options    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_password         = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_private_key      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_share_path       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_ssh_port         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.num_shell_tries      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.nvmet_port_id        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.replication_device   = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.report_discard_supported = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.reserved_percentage  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.scst_target_driver   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.storage_protocol     = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_helper        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_ip_address    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_port          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_prefix        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_protocol      = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.trace_flags          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.use_chap_auth        = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_clear         = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_clear_size    = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] QuobyteHD.volumes_dir          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl      = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_notifications.driver = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_notifications.retry = -1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] key_manager.fixed_key          = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.barbican_api_version  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.barbican_endpoint     = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.barbican_endpoint_type = public {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.barbican_region_name  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.cafile                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.certfile              = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.collect_timing        = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.insecure              = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.keyfile               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.number_of_retries     = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.retry_delay           = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.send_service_user_token = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.split_loggers         = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.timeout               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.tls_ciphers           = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.tls_min_version       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.verify_ssl            = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican.verify_ssl_path       = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.auth_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.cafile   = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.collect_timing = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.keyfile  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.timeout  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.tls_ciphers = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] barbican_service_user.tls_min_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.approle_role_id          = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.approle_secret_id        = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.auth_method              = approle {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.auth_path                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.kv_mountpoint            = secret {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.kv_path                  = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.kv_version               = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.namespace                = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.root_token_id            = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.ssl_ca_crt_file          = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.timeout                  = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.token_file               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.token_role               = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.use_ssl                  = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 11:34:35 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-dba93eae-7872-4c92-acd0-48f43d456c4e None None] ******************************************************************************** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 11:34:35 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.279s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.volume.driver [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.driver [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4321403503418, 'free_capacity_gb': 1775.4321403503418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87358) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_db.sqlalchemy.engines [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writer thread running {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.db.api [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Building query based on filter {{(pid=87358) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87358) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.keymgr.migration [None req-6d969eea-be45-47d5-8a59-ed60ff115b1a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 11:34:35 devstack sudo[87364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:35 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:35 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.292s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Driver initialization completed successfully.
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Initiating service 3 cleanup
Sep 25 11:34:35 devstack cinder-volume[87358]: INFO cinder.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Service 3 cleanup completed.
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.service [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Creating RPC server for service cinder-volume {{(pid=87358) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 11:34:35 devstack cinder-volume[87358]: DEBUG cinder.service [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87358) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 11:34:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:34:36 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:34:36 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:34:36 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Sep 25 11:34:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.348s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:34:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d140770c-4e68-441f-9c6f-018a52ad6d06 None None] Driver post RPC initialization completed successfully.
Sep 25 11:34:44 devstack cinder-volume[87062]: DEBUG dbcounter [-] [87062] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:45 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:46 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:34:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:34:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 6 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:34:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Flow 'volume_create_manager' (24c5e76f-dfa5-452a-9deb-450ebb23520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c09a9e-acf2-4b1d-9e13-8e21d53f450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c09a9e-acf2-4b1d-9e13-8e21d53f450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-469558318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc8c5ce-3b9a-4851-9542-a8b000e6e26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9528d64e1a4fd1877aa6a54c2c117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:34Z,use_quota=True,user_id='451113d6c2754a18a221cd662d9ca68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f045cf-0976-4a9f-bbb8-b898d8bcecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f045cf-0976-4a9f-bbb8-b898d8bcecfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1500a9f2-ccff-4516-b56c-95c1bf29e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1500a9f2-ccff-4516-b56c-95c1bf29e787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc8c5ce-3b9a-4851-9542-a8b000e6e26a', 'volume_name': 'volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2a02a1-ed9d-4bf8-9c9c-4cbd58c7665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2a02a1-ed9d-4bf8-9c9c-4cbd58c7665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8760b0a6-5d92-4aba-9dfc-13b3d5f2b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:34 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Volume 1dc8c5ce-3b9a-4851-9542-a8b000e6e26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a', 'volume_size': 1}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-469558318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc8c5ce-3b9a-4851-9542-a8b000e6e26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9528d64e1a4fd1877aa6a54c2c117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:34Z,use_quota=True,user_id='451113d6c2754a18a221cd662d9ca68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Creating volume 1dc8c5ce-3b9a-4851-9542-a8b000e6e26a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:35:34 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:35:34 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a 1073741824
Sep 25 11:35:34 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:35:34 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a 1073741824" returned: 0 in 0.739s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:35:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:35:35 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a
Sep 25 11:35:35 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:35:35 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" returned: 0 in 0.570s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8760b0a6-5d92-4aba-9dfc-13b3d5f2b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6e60f-99fc-4b24-ac57-65984f7c1a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Volume volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a (1dc8c5ce-3b9a-4851-9542-a8b000e6e26a): created successfully
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6e60f-99fc-4b24-ac57-65984f7c1a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Flow 'volume_create_manager' (24c5e76f-dfa5-452a-9deb-450ebb23520e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:35:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-953aa978-aba8-4184-9297-d56feb1bce71 tempest-TaggedAttachmentsTest-1901885497 None] Created volume successfully.
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Flow 'volume_create_manager' (dd12696e-8f8f-4106-880b-132c788bd8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94342ee1-8e07-4325-bcdf-9de6d465e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94342ee1-8e07-4325-bcdf-9de6d465e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1312961626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26d008a-f515-43ae-b6ca-36df305f9c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bbb1110ec41dca961917ccdf015b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:45Z,use_quota=True,user_id='680179780f3f4d26a05d4c09056a6ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75439e1d-6dba-4599-91f3-2708d42400d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75439e1d-6dba-4599-91f3-2708d42400d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8796d9-4a0f-4626-95b3-53c053355695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8796d9-4a0f-4626-95b3-53c053355695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26d008a-f515-43ae-b6ca-36df305f9c24', 'volume_name': 'volume-c26d008a-f515-43ae-b6ca-36df305f9c24', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4730bf-fc97-4fc3-be44-44b8e16f99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4730bf-fc97-4fc3-be44-44b8e16f99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fae549-f93c-409d-bbc8-a3a4246fea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:45 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Volume c26d008a-f515-43ae-b6ca-36df305f9c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26d008a-f515-43ae-b6ca-36df305f9c24', 'volume_size': 1}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1312961626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26d008a-f515-43ae-b6ca-36df305f9c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bbb1110ec41dca961917ccdf015b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:45Z,use_quota=True,user_id='680179780f3f4d26a05d4c09056a6ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Creating volume c26d008a-f515-43ae-b6ca-36df305f9c24 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:35:45 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:35:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:35:45 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 1073741824
Sep 25 11:35:45 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:35:47 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Sep 25 11:35:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 1073741824" returned: 0 in 1.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:35:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:35:47 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24
Sep 25 11:35:47 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:35:47 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Sep 25 11:35:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24" returned: 0 in 0.662s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:35:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:35:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fae549-f93c-409d-bbc8-a3a4246fea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26d008a-f515-43ae-b6ca-36df305f9c24', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee19acb2-76f2-4c28-b2ca-6b66994011c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:35:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Volume volume-c26d008a-f515-43ae-b6ca-36df305f9c24 (c26d008a-f515-43ae-b6ca-36df305f9c24): created successfully
Sep 25 11:35:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee19acb2-76f2-4c28-b2ca-6b66994011c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:35:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Flow 'volume_create_manager' (dd12696e-8f8f-4106-880b-132c788bd8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:35:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f9537c4c-7197-45b8-b26f-ea102c3d6bfd tempest-DeleteServersTestJSON-2071559322 None] Created volume successfully.
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:35:51 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:35:51 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:35:52 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Sep 25 11:35:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.906s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:35:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:35:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:35:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 6 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:35:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:35:55 devstack cinder-volume[87358]: WARNING py.warnings [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 25 11:35:55 devstack cinder-volume[87358]:   .first()
Sep 25 11:35:55 devstack cinder-volume[87358]: 
Sep 25 11:35:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:35:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:35:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:35:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-c26d008a-f515-43ae-b6ca-36df305f9c24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40b5c07c-66a1-4df9-875b-e019327815e3', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:35:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-c47c8b71-1957-4079-8949-42d77f3cc089 req-1a15cd3a-4eb5-4ce1-b80b-fc7c2adfcc65 tempest-DeleteServersTestJSON-2071559322 None] attachment_update completed successfully.
Sep 25 11:36:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-92f6698f-c7f9-4d9e-a05e-79ad48a4bdc8 req-ac851e8b-0e52-4cf0-ac72-df411c5e14e2 tempest-DeleteServersTestJSON-2071559322 None] Terminate volume connection completed successfully.
Sep 25 11:36:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-92f6698f-c7f9-4d9e-a05e-79ad48a4bdc8 req-ac851e8b-0e52-4cf0-ac72-df411c5e14e2 tempest-DeleteServersTestJSON-2071559322 None] Deleting attachment 40b5c07c-66a1-4df9-875b-e019327815e3. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:36:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "cinder-c26d008a-f515-43ae-b6ca-36df305f9c24-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "cinder-c26d008a-f515-43ae-b6ca-36df305f9c24-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "cinder-quobyte-c26d008a-f515-43ae-b6ca-36df305f9c24" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "cinder-quobyte-c26d008a-f515-43ae-b6ca-36df305f9c24" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:05 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8pd1gjxj/privsep.sock']
Sep 25 11:36:05 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8pd1gjxj/privsep.sock
Sep 25 11:36:05 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 11:36:07 devstack cinder-volume[87358]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 25 11:36:07 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:07 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Spawned new privsep daemon via rootwrap
Sep 25 11:36:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Accepted privsep connection to /tmp/tmp8pd1gjxj/privsep.sock {{(pid=87358) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 25 11:36:07 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 25 11:36:07 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 25 11:36:07 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 25 11:36:07 devstack cinder-volume[87358]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88992
Sep 25 11:36:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d5f713-1a92-4815-8d55-bba8784e6d60]: (2,) {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[847caf51-fa34-4165-9900-3ab8269f26d7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:08 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24
Sep 25 11:36:08 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:08 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24" returned: 0 in 0.861s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:08 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24
Sep 25 11:36:08 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:09 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c26d008a-f515-43ae-b6ca-36df305f9c24" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "cinder-quobyte-c26d008a-f515-43ae-b6ca-36df305f9c24" released by "delete_volume" :: held 3.597s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:09 devstack cinder-volume[87358]: WARNING cinder.quota [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:36:09 devstack cinder-volume[87358]: WARNING cinder.quota [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Created reservations ['8af8b644-63ef-443f-bf77-d4afcf61b3ff', '107245f5-a9fe-4484-a897-1db908fa86be', 'b7c8753b-3239-4252-b46f-34a78d6fe330', '1edbe9e9-9f93-49b6-8a9f-7321937efa8d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:09 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:09 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:09 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.348s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:09 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Deleted volume successfully.
Sep 25 11:36:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-befc6478-8475-4a55-bc71-5d9a635717b4 tempest-DeleteServersTestJSON-2071559322 None] Lock "cinder-c26d008a-f515-43ae-b6ca-36df305f9c24-delete_volume" released by "delete_volume" :: held 4.419s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Flow 'volume_create_manager' (b7949f60-0ffc-43f4-8c26-97f9742b7848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffacf7-0aa3-4713-b6b0-f8e2727a1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffacf7-0aa3-4713-b6b0-f8e2727a1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-824909460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2346dadf-657f-409e-85cd-8f2a8c7b9247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9952cdd2e7804a07855d66070627fa10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:13Z,use_quota=True,user_id='bcb77480d4f24508a76cd80f03e8d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a400e7-2c7b-484b-91c3-ce2d90d79d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a400e7-2c7b-484b-91c3-ce2d90d79d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deddda93-b5c8-42e1-bd7b-894ed692794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deddda93-b5c8-42e1-bd7b-894ed692794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2346dadf-657f-409e-85cd-8f2a8c7b9247', 'volume_name': 'volume-2346dadf-657f-409e-85cd-8f2a8c7b9247', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3287603-15d2-4e9b-9cc8-43ae7112d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3287603-15d2-4e9b-9cc8-43ae7112d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d100f9c-7671-4bb6-9caf-0b160a8286d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:13 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Volume 2346dadf-657f-409e-85cd-8f2a8c7b9247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2346dadf-657f-409e-85cd-8f2a8c7b9247', 'volume_size': 1}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-824909460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2346dadf-657f-409e-85cd-8f2a8c7b9247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9952cdd2e7804a07855d66070627fa10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:13Z,use_quota=True,user_id='bcb77480d4f24508a76cd80f03e8d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Creating volume 2346dadf-657f-409e-85cd-8f2a8c7b9247 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:13 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:13 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 1073741824
Sep 25 11:36:13 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:14 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 1073741824" returned: 0 in 0.671s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:14 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247
Sep 25 11:36:14 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:14 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d100f9c-7671-4bb6-9caf-0b160a8286d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2346dadf-657f-409e-85cd-8f2a8c7b9247', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464c6b26-51f4-4470-b967-ba8bf34d12de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:14 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Volume volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 (2346dadf-657f-409e-85cd-8f2a8c7b9247): created successfully
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464c6b26-51f4-4470-b967-ba8bf34d12de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Flow 'volume_create_manager' (b7949f60-0ffc-43f4-8c26-97f9742b7848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5596e7b5-e934-4f7b-bc1c-df1cb299fbb5 tempest-ServersNegativeTestJSON-312986838 None] Created volume successfully.
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Flow 'volume_create_manager' (48388ff3-413a-479a-ad76-5adb646672ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57b85dc-6ec0-4bf7-b7c4-486c79d6f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57b85dc-6ec0-4bf7-b7c4-486c79d6f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1972207543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6a0429-b186-46c6-b65c-2b77b6ebce79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9952cdd2e7804a07855d66070627fa10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:18Z,use_quota=True,user_id='bcb77480d4f24508a76cd80f03e8d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18649369-5bc8-42e2-bb35-9b0d5a1d655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18649369-5bc8-42e2-bb35-9b0d5a1d655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66609d0f-82e6-472a-841d-53a2979064fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66609d0f-82e6-472a-841d-53a2979064fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6a0429-b186-46c6-b65c-2b77b6ebce79', 'volume_name': 'volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825fd2ec-be1b-4b12-a47e-819530994c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825fd2ec-be1b-4b12-a47e-819530994c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f74b0-f3c5-4b52-aa19-0a89b9a6f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Volume 9f6a0429-b186-46c6-b65c-2b77b6ebce79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79', 'volume_size': 1}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1972207543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6a0429-b186-46c6-b65c-2b77b6ebce79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9952cdd2e7804a07855d66070627fa10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:18Z,use_quota=True,user_id='bcb77480d4f24508a76cd80f03e8d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Creating volume 9f6a0429-b186-46c6-b65c-2b77b6ebce79 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:18 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:18 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 1073741824
Sep 25 11:36:18 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:18 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 1073741824" returned: 0 in 0.584s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:19 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79
Sep 25 11:36:19 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:19 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f74b0-f3c5-4b52-aa19-0a89b9a6f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b56b2-52e6-44a0-9d0e-f26c7cbc45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Volume volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 (9f6a0429-b186-46c6-b65c-2b77b6ebce79): created successfully
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b56b2-52e6-44a0-9d0e-f26c7cbc45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Flow 'volume_create_manager' (48388ff3-413a-479a-ad76-5adb646672ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-51cfe28d-e38c-48ed-aab8-fc8225fd49e9 tempest-ServersNegativeTestJSON-312986838 None] Created volume successfully.
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "cinder-9f6a0429-b186-46c6-b65c-2b77b6ebce79-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-9f6a0429-b186-46c6-b65c-2b77b6ebce79-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "cinder-quobyte-9f6a0429-b186-46c6-b65c-2b77b6ebce79" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-quobyte-9f6a0429-b186-46c6-b65c-2b77b6ebce79" acquired by "delete_volume" :: waited 0.039s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bc329-b5d3-4fc7-9025-50c95ec04c7b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:21 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79
Sep 25 11:36:21 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:21 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79" returned: 0 in 0.624s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:21 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79
Sep 25 11:36:21 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:22 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f6a0429-b186-46c6-b65c-2b77b6ebce79" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-quobyte-9f6a0429-b186-46c6-b65c-2b77b6ebce79" released by "delete_volume" :: held 1.035s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Created reservations ['f3608144-b8c4-45c7-8329-1560e40cd878', 'e27f37b0-11f9-49f8-a571-fe17f80afeaa', '64aee95a-ee78-4d37-8483-fde828407217', 'bd24196d-c088-4fa7-b4bf-8391cee4c585'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:22 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:22 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (94b5b9b1-151c-4ec2-b876-c1c4edd8e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb936dc-d5c1-4e80-9726-08f198ef126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb936dc-d5c1-4e80-9726-08f198ef126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1919306835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3678efc-688e-43b5-866d-a923f775c9a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:22Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db73fe8e-dcfa-404f-a82b-e69838efee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db73fe8e-dcfa-404f-a82b-e69838efee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e700e-ab1d-4387-905c-85a7ad1d8001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e700e-ab1d-4387-905c-85a7ad1d8001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3678efc-688e-43b5-866d-a923f775c9a0', 'volume_name': 'volume-e3678efc-688e-43b5-866d-a923f775c9a0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45af3c50-2d8c-4b73-a791-edeea4ff3fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45af3c50-2d8c-4b73-a791-edeea4ff3fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93312041-004f-46f5-a3e5-baa8064a27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Volume e3678efc-688e-43b5-866d-a923f775c9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3678efc-688e-43b5-866d-a923f775c9a0', 'volume_size': 1}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1919306835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3678efc-688e-43b5-866d-a923f775c9a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:22Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Creating volume e3678efc-688e-43b5-866d-a923f775c9a0 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:22 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:22 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 1073741824
Sep 25 11:36:22 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:22 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.281s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Deleted volume successfully.
Sep 25 11:36:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4fbcbae3-2ccf-4d82-bd9a-6afe6affdcc1 tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-9f6a0429-b186-46c6-b65c-2b77b6ebce79-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:23 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 1073741824" returned: 0 in 0.517s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:23 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0
Sep 25 11:36:23 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:23 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0" returned: 0 in 0.273s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93312041-004f-46f5-a3e5-baa8064a27ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3678efc-688e-43b5-866d-a923f775c9a0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70afd1d-ecf4-41dc-a586-d34538b271c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "cinder-2346dadf-657f-409e-85cd-8f2a8c7b9247-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Volume volume-e3678efc-688e-43b5-866d-a923f775c9a0 (e3678efc-688e-43b5-866d-a923f775c9a0): created successfully
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70afd1d-ecf4-41dc-a586-d34538b271c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (94b5b9b1-151c-4ec2-b876-c1c4edd8e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-2346dadf-657f-409e-85cd-8f2a8c7b9247-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5dc5344e-9b64-4d20-a0cf-2823c1e03cd7 tempest-VolumesTestJSON-1133587452 None] Created volume successfully.
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "cinder-quobyte-2346dadf-657f-409e-85cd-8f2a8c7b9247" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-quobyte-2346dadf-657f-409e-85cd-8f2a8c7b9247" acquired by "delete_volume" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af0f12-47dc-46b5-823a-acf09211a07f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:23 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247
Sep 25 11:36:23 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:24 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247" returned: 0 in 0.419s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:24 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247
Sep 25 11:36:24 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:24 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2346dadf-657f-409e-85cd-8f2a8c7b9247" returned: 0 in 0.249s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-quobyte-2346dadf-657f-409e-85cd-8f2a8c7b9247" released by "delete_volume" :: held 0.724s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Created reservations ['915bcb57-3e73-4338-9645-56c2b93333d6', '889f334b-10c9-48d4-a7ae-d513c3f8b775', 'd2f8e6e1-5f19-4891-9e5f-f8225aee16a4', '4591359b-189f-4110-8001-d27d29b7ce95'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:24 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:24 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:24 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.301s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Deleted volume successfully.
Sep 25 11:36:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d3bed4b6-baea-4dd0-8e26-6958f0a2bbab tempest-ServersNegativeTestJSON-312986838 None] Lock "cinder-2346dadf-657f-409e-85cd-8f2a8c7b9247-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (758b560c-636b-4089-8d04-0eb97ebb88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc77b995-e57b-4909-8812-c1d2e2303bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc77b995-e57b-4909-8812-c1d2e2303bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-670747075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0289c384-7b76-4857-948e-010ef9819e8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:25Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c285dd-6d2f-42e3-80c3-e2536b48d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c285dd-6d2f-42e3-80c3-e2536b48d112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c980cc-2dc0-4f81-905d-ce77656c7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c980cc-2dc0-4f81-905d-ce77656c7113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0289c384-7b76-4857-948e-010ef9819e8e', 'volume_name': 'volume-0289c384-7b76-4857-948e-010ef9819e8e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4138f91b-8264-4966-8cd5-3d282416454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4138f91b-8264-4966-8cd5-3d282416454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153123ff-5ced-4e4d-9175-07085ac0fcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:25 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Volume 0289c384-7b76-4857-948e-010ef9819e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0289c384-7b76-4857-948e-010ef9819e8e', 'volume_size': 1}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-670747075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0289c384-7b76-4857-948e-010ef9819e8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:25Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Creating volume 0289c384-7b76-4857-948e-010ef9819e8e {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:25 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:25 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e 1073741824
Sep 25 11:36:25 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:26 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e 1073741824" returned: 0 in 0.725s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=40,cinder:SELECT=39,cinder:INSERT=5,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:26 devstack sudo[89143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e
Sep 25 11:36:26 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:26 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e" returned: 0 in 0.387s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153123ff-5ced-4e4d-9175-07085ac0fcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0289c384-7b76-4857-948e-010ef9819e8e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc9953-c425-4c50-9112-f2199e554fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Volume volume-0289c384-7b76-4857-948e-010ef9819e8e (0289c384-7b76-4857-948e-010ef9819e8e): created successfully
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc9953-c425-4c50-9112-f2199e554fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (758b560c-636b-4089-8d04-0eb97ebb88ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:26 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=30,cinder:INSERT=13,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:36:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9e05d3e9-db8e-4d3c-bbd4-81354251d02f tempest-VolumesTestJSON-1133587452 None] Created volume successfully.
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (d2051f85-4669-4860-a4cb-65eab64a7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db941f4d-0cbc-4320-ba57-a1b93351839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db941f4d-0cbc-4320-ba57-a1b93351839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1651999058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72edd8f3-24ad-49b6-91a6-90da531bfb5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:28Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482279d-bd7f-4c05-8dbe-27c7e5e7a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482279d-bd7f-4c05-8dbe-27c7e5e7a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ccfaa6-4052-41cd-81e4-09f578e9989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ccfaa6-4052-41cd-81e4-09f578e9989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72edd8f3-24ad-49b6-91a6-90da531bfb5c', 'volume_name': 'volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d2163-2fce-461a-a0e6-27f50664c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d2163-2fce-461a-a0e6-27f50664c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d92a31-c061-45f0-8467-23d22b18b0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Volume 72edd8f3-24ad-49b6-91a6-90da531bfb5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c', 'volume_size': 1}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1651999058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72edd8f3-24ad-49b6-91a6-90da531bfb5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23fe6d704d6c41a0ab46142978de998f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:28Z,use_quota=True,user_id='7de2fadbc85f401ebcd4be5a7d15ccde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Creating volume 72edd8f3-24ad-49b6-91a6-90da531bfb5c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:28 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:28 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c 1073741824
Sep 25 11:36:28 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:29 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c 1073741824" returned: 0 in 0.647s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:29 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c
Sep 25 11:36:29 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:29 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c" returned: 0 in 0.355s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d92a31-c061-45f0-8467-23d22b18b0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fc96ac-a0b6-47f9-b92c-c34031402dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Volume volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c (72edd8f3-24ad-49b6-91a6-90da531bfb5c): created successfully
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fc96ac-a0b6-47f9-b92c-c34031402dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Flow 'volume_create_manager' (d2051f85-4669-4860-a4cb-65eab64a7c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fe634b24-050c-4d92-9640-dfcc7e1d5405 tempest-VolumesTestJSON-1133587452 None] Created volume successfully.
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-72edd8f3-24ad-49b6-91a6-90da531bfb5c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-72edd8f3-24ad-49b6-91a6-90da531bfb5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-quobyte-72edd8f3-24ad-49b6-91a6-90da531bfb5c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-72edd8f3-24ad-49b6-91a6-90da531bfb5c" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e8fc48-9c81-4144-8020-c4fcfb0eb2ba]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:31 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c
Sep 25 11:36:31 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:32 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c" returned: 0 in 0.527s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:32 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c
Sep 25 11:36:32 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:32 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-72edd8f3-24ad-49b6-91a6-90da531bfb5c" returned: 0 in 0.277s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-72edd8f3-24ad-49b6-91a6-90da531bfb5c" released by "delete_volume" :: held 0.856s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Created reservations ['15d01644-f881-4dd8-9939-67a764288e02', 'bc233910-2ee5-4560-a49a-2042e7e6ad8d', '80edfc5a-528a-4ac3-9f0b-3908e1476a04', '837e4f2a-803e-49ad-9989-799d118878c5'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:32 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:32 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:33 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.344s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Deleted volume successfully.
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d5f69a99-4ca5-4546-9ee2-15bbf2441377 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-72edd8f3-24ad-49b6-91a6-90da531bfb5c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-0289c384-7b76-4857-948e-010ef9819e8e-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-0289c384-7b76-4857-948e-010ef9819e8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-quobyte-0289c384-7b76-4857-948e-010ef9819e8e" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-0289c384-7b76-4857-948e-010ef9819e8e" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f16915-1bad-4275-837c-4ee47d809155]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:33 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e
Sep 25 11:36:33 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:33 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e" returned: 0 in 0.468s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:33 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e
Sep 25 11:36:33 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:34 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0289c384-7b76-4857-948e-010ef9819e8e" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-0289c384-7b76-4857-948e-010ef9819e8e" released by "delete_volume" :: held 0.891s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Created reservations ['254c4205-66a5-4016-a165-242d7503fb9a', '206a42bf-da5f-43cc-9cf2-ebf6c542db46', '19424657-8885-4828-a370-b14867f42e30', '38affc50-0f34-4600-871d-1add8d2b6c73'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:34 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:34 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-e3678efc-688e-43b5-866d-a923f775c9a0-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-e3678efc-688e-43b5-866d-a923f775c9a0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "cinder-quobyte-e3678efc-688e-43b5-866d-a923f775c9a0" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-e3678efc-688e-43b5-866d-a923f775c9a0" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0742c6c5-8f49-47c9-9b38-8f8ff0d9999a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:34 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0
Sep 25 11:36:34 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:34 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.539s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:34 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:34 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Deleted volume successfully.
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-88ec7b29-be22-47dd-8bd1-fbdb40ccd0d9 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-0289c384-7b76-4857-948e-010ef9819e8e-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:35 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0" returned: 0 in 0.647s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:35 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0
Sep 25 11:36:35 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:35 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e3678efc-688e-43b5-866d-a923f775c9a0" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-quobyte-e3678efc-688e-43b5-866d-a923f775c9a0" released by "delete_volume" :: held 1.077s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Created reservations ['5e2508c6-ad7c-4250-bde9-a0844c079ba5', 'eff4de6f-f753-4064-adcf-cfc48a93a038', '5077d81e-1687-4477-9c66-b8ac5206233a', 'd2cc2bb1-cb75-41f1-a8af-040e2a25586c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:35 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:35 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:36 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.289s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:36 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Deleted volume successfully.
Sep 25 11:36:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7a80a266-a6f9-41cd-8c72-2ef79da972c6 tempest-VolumesTestJSON-1133587452 None] Lock "cinder-e3678efc-688e-43b5-866d-a923f775c9a0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:36:46 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=31,cinder:DELETE=3,cinder:SELECT=18,cinder:INSERT=8 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:36:46 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=26,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-588e8175-1956-4092-b4a7-c51ba51b877c req-6168f3ce-7f21-4dd3-bd6b-6f3a17b72ed3 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-588e8175-1956-4092-b4a7-c51ba51b877c req-6168f3ce-7f21-4dd3-bd6b-6f3a17b72ed3 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-588e8175-1956-4092-b4a7-c51ba51b877c req-6168f3ce-7f21-4dd3-bd6b-6f3a17b72ed3 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:51 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:36:51 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-588e8175-1956-4092-b4a7-c51ba51b877c req-6168f3ce-7f21-4dd3-bd6b-6f3a17b72ed3 tempest-TaggedAttachmentsTest-1901885497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '519c2d94-0be7-49db-9edf-20c017477093', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:36:51 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-588e8175-1956-4092-b4a7-c51ba51b877c req-6168f3ce-7f21-4dd3-bd6b-6f3a17b72ed3 tempest-TaggedAttachmentsTest-1901885497 None] attachment_update completed successfully.
Sep 25 11:36:52 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.575s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:36:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cedaaf41-b7a0-45eb-91cc-138a94760671 tempest-GroupsV314Test-1759089969 None] Group tempest-GroupsV314Test-Group-1009682460: creating
Sep 25 11:36:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cedaaf41-b7a0-45eb-91cc-138a94760671 tempest-GroupsV314Test-1759089969 None] Group tempest-GroupsV314Test-Group-1009682460: created successfully
Sep 25 11:36:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cedaaf41-b7a0-45eb-91cc-138a94760671 tempest-GroupsV314Test-1759089969 None] Create group completed successfully.
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Flow 'volume_create_manager' (17cfddd1-c03b-4ac5-a1e3-0c0cbda204fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fdc195-3f63-435f-b71a-33c4533e0dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fdc195-3f63-435f-b71a-33c4533e0dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427904623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce78b68a-05f8-4024-a799-9138ec0353f5,host='devstack@QuobyteHD#QuobyteHD',id=5a6e16ec-46ab-482d-9ebf-408e6700553f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3a27373ebd4fb1ab31e35bd676bdf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:54Z,use_quota=True,user_id='a07616daa3dc4d2787bb40007f4549eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85dfab7a-fcef-4787-ac17-b640763ea41c),volume_type_id=85dfab7a-fcef-4787-ac17-b640763ea41c)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264ae8a-97ab-4990-bca5-23d15783296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264ae8a-97ab-4990-bca5-23d15783296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f079fcf-0c99-482a-8f59-cf3f076fe944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f079fcf-0c99-482a-8f59-cf3f076fe944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6e16ec-46ab-482d-9ebf-408e6700553f', 'volume_name': 'volume-5a6e16ec-46ab-482d-9ebf-408e6700553f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db543047-a45f-464f-96d7-58989e7a9986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db543047-a45f-464f-96d7-58989e7a9986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55989f6d-5ae3-4392-9f20-da0e7c44ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:54 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Volume 5a6e16ec-46ab-482d-9ebf-408e6700553f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6e16ec-46ab-482d-9ebf-408e6700553f', 'volume_size': 1}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce78b68a-05f8-4024-a799-9138ec0353f5,created_at=2026-09-25T09:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427904623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce78b68a-05f8-4024-a799-9138ec0353f5,host='devstack@QuobyteHD#QuobyteHD',id=5a6e16ec-46ab-482d-9ebf-408e6700553f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3a27373ebd4fb1ab31e35bd676bdf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:54Z,use_quota=True,user_id='a07616daa3dc4d2787bb40007f4549eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85dfab7a-fcef-4787-ac17-b640763ea41c),volume_type_id=85dfab7a-fcef-4787-ac17-b640763ea41c)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Creating volume 5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:36:54 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:36:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:54 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f 1073741824
Sep 25 11:36:54 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:55 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f 1073741824" returned: 0 in 0.557s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:55 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:36:55 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:55 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55989f6d-5ae3-4392-9f20-da0e7c44ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6e16ec-46ab-482d-9ebf-408e6700553f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48bd90b-a8a1-4e98-aee3-e16aa2c3a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:36:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Volume volume-5a6e16ec-46ab-482d-9ebf-408e6700553f (5a6e16ec-46ab-482d-9ebf-408e6700553f): created successfully
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48bd90b-a8a1-4e98-aee3-e16aa2c3a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:36:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Flow 'volume_create_manager' (17cfddd1-c03b-4ac5-a1e3-0c0cbda204fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:36:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d587c405-59e1-4b80-932d-d7eeebfa4254 tempest-GroupsV314Test-1759089969 None] Created volume successfully.
Sep 25 11:36:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:36:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:36:56 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Cloning volume 5a6e16ec-46ab-482d-9ebf-408e6700553f to volume 0167881d-ed00-442d-b35a-a71785c7e5bd
Sep 25 11:36:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Creating offline snapshot da35e0e8-91dc-43be-b7d3-82b90502993b of volume 5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:36:56 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6a594-b840-49c6-8cfa-95fee76320ec]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:36:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:56 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:36:56 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:57 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.689s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:57 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b 1G
Sep 25 11:36:57 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:58 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b 1G" returned: 0 in 0.738s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e16ec-46ab-482d-9ebf-408e6700553f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:58 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e16ec-46ab-482d-9ebf-408e6700553f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:36:58 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-748b324f-37af-4d82-8102-5ea69b92831c req-03b5ada3-47e1-4ad6-b94d-12df6c229665 tempest-TaggedAttachmentsTest-1901885497 None] Terminate volume connection completed successfully.
Sep 25 11:36:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-748b324f-37af-4d82-8102-5ea69b92831c req-03b5ada3-47e1-4ad6-b94d-12df6c229665 tempest-TaggedAttachmentsTest-1901885497 None] Deleting attachment 519c2d94-0be7-49db-9edf-20c017477093. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:36:58 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e16ec-46ab-482d-9ebf-408e6700553f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.484s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:58 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:36:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:58 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:36:58 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:59 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.436s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:59 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info
Sep 25 11:36:59 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:59 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info" returned: 0 in 0.337s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:36:59 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:36:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:36:59 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info
Sep 25 11:36:59 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:36:59 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Sep 25 11:36:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.info" returned: 0 in 0.370s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Acquiring lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] snapshot: da35e0e8-91dc-43be-b7d3-82b90502993b, volume: 0167881d-ed00-442d-b35a-a71785c7e5bd,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850d9ec-b339-4d30-b823-bcab98b92e5f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:00 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:37:00 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:00 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.677s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6e16ec-46ab-482d-9ebf-408e6700553f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf2b2e-060c-4e17-b8f8-221bf8f9a17f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:01 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:37:01 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:01 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.529s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:37:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:37:01 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:37:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:01 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd
Sep 25 11:37:01 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:09 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:37:09 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:37:11 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd" returned: 0 in 10.569s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:11 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f, size 1024.00 MB, duration 10.57 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:37:11 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Converted 1024.00 MB image at 96.88 MB/s
Sep 25 11:37:11 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:37:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:12 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd
Sep 25 11:37:12 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:12 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" released by "_copy_volume_from_snapshot" :: held 12.280s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Acquiring lock "cinder-quobyte-da35e0e8-91dc-43be-b7d3-82b90502993b" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-da35e0e8-91dc-43be-b7d3-82b90502993b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Deleting offline snapshot da35e0e8-91dc-43be-b7d3-82b90502993b of volume 5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] snapshot_file for this snap is: volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b091cf-fe07-4f08-9090-f9f7fb090d72]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:12 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:37:12 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:12 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.420s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6e16ec-46ab-482d-9ebf-408e6700553f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b92c3-6b2c-4dc2-9f89-e11d5cf9408f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:13 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:37:13 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:13 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.785s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:13 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:37:13 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:14 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.468s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:14 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b
Sep 25 11:37:14 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:14 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f.da35e0e8-91dc-43be-b7d3-82b90502993b" returned: 0 in 0.451s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-da35e0e8-91dc-43be-b7d3-82b90502993b" released by "_delete_snapshot" :: held 2.271s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.947s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-630c5803-2cd5-4e18-a406-d552e238ed1d tempest-GroupsV314Test-1759089969 None] Create group from source-group-ce78b68a-05f8-4024-a799-9138ec0353f5 completed successfully.
Sep 25 11:37:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Acquiring lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:16 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f8c9a6-36d0-461e-afe0-f5656e327d6a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:16 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd
Sep 25 11:37:16 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:17 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd" returned: 0 in 0.654s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:17 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd
Sep 25 11:37:17 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:17 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0167881d-ed00-442d-b35a-a71785c7e5bd" returned: 0 in 0.336s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-0167881d-ed00-442d-b35a-a71785c7e5bd" released by "delete_volume" :: held 1.119s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Created reservations ['c14e83ea-71aa-4737-a8b8-9d633a9d33ea'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:17 devstack cinder-volume[87358]: WARNING cinder.quota [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-770449985 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-770449985, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:37:17 devstack cinder-volume[87358]: WARNING cinder.quota [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-770449985 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-770449985, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Created reservations ['7db8c2fa-d25b-4518-93d9-c3950ef80627', 'e6a7ae65-8f64-4a77-9ba0-ae71950aeaf6', '6007d30f-aee3-48f1-a174-1864f33be0de', '2fbb0f31-5a89-4fcf-829e-68b9e65e82f7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:17 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:37:17 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:18 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.317s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:18 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:37:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1dd82cdb-242e-4f9c-88a9-84a4a841be10 tempest-GroupsV314Test-1759089969 None] Delete group completed successfully.
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "cinder-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "cinder-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "cinder-quobyte-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "cinder-quobyte-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ec179-9d2c-4af2-8a89-dee22c4940dd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Acquiring lock "cinder-quobyte-5a6e16ec-46ab-482d-9ebf-408e6700553f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-5a6e16ec-46ab-482d-9ebf-408e6700553f" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:19 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a
Sep 25 11:37:19 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102e2ce-97de-4623-aca1-a591ef765050]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:19 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:37:19 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:19 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" returned: 0 in 0.628s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:20 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a
Sep 25 11:37:20 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:20 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.738s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:20 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f
Sep 25 11:37:20 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:20 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" returned: 0 in 0.603s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "cinder-quobyte-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a" released by "delete_volume" :: held 1.329s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Created reservations ['10f13f30-326d-41c4-9142-6eb501b13a92', 'b627c2b4-6def-4d67-9f03-0d4e056223e4', 'a72330c8-8ae5-480e-849b-9a8d3bcbd61c', 'ace13109-192c-4941-bdcf-107cc215ec1f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:20 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5a6e16ec-46ab-482d-9ebf-408e6700553f" returned: 0 in 0.483s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Lock "cinder-quobyte-5a6e16ec-46ab-482d-9ebf-408e6700553f" released by "delete_volume" :: held 1.353s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:20 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:37:20 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Created reservations ['e7eeacd0-6f31-4d99-9f5b-fef321759577'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Created reservations ['8213d1a8-c599-4ec3-8f2d-24d5a6f8b57e', '4ce5c8cf-573a-480b-86bd-60453c27ceef', '16211124-c22e-40ee-94d7-42cff47c88fe', 'b8a115e7-ea70-4975-afb0-b55371e5ce24'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:21 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:37:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Deleted volume successfully.
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3d238ec3-8190-454b-bba3-1916ffe70fc8 tempest-TaggedAttachmentsTest-1901885497 None] Lock "cinder-1dc8c5ce-3b9a-4851-9542-a8b000e6e26a-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:21 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:37:21 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:22 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.610s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:22 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:37:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ec87af36-c114-4db5-a70e-5ed6f18fbe04 tempest-GroupsV314Test-1759089969 None] Delete group completed successfully.
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Flow 'volume_create_manager' (ddebc26d-2cb3-4208-908b-febe1b3d3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b64de4-d079-4112-b646-c0000df3f61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b64de4-d079-4112-b646-c0000df3f61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-883571879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bedbda-e6ec-4e46-9743-bf3126d6a49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac162b22dc74264b8f46c12f52a0e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:30Z,use_quota=True,user_id='8559f526f942434bb03c3ab0a225b5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa75f9e-59ff-4ec2-bbe5-2f306c4493cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa75f9e-59ff-4ec2-bbe5-2f306c4493cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb0ebae-584f-42b2-a5bb-cb25cff9db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb0ebae-584f-42b2-a5bb-cb25cff9db4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bedbda-e6ec-4e46-9743-bf3126d6a49f', 'volume_name': 'volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410c6518-6e89-409a-99b7-5f64d2fcd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410c6518-6e89-409a-99b7-5f64d2fcd32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8584c5-6c50-4875-9029-7829e05e8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:30 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Volume 00bedbda-e6ec-4e46-9743-bf3126d6a49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f', 'volume_size': 1}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-883571879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bedbda-e6ec-4e46-9743-bf3126d6a49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac162b22dc74264b8f46c12f52a0e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:30Z,use_quota=True,user_id='8559f526f942434bb03c3ab0a225b5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Creating volume 00bedbda-e6ec-4e46-9743-bf3126d6a49f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:37:30 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:37:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:30 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f 1073741824
Sep 25 11:37:30 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:31 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f 1073741824" returned: 0 in 0.773s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:31 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f
Sep 25 11:37:31 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:31 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8584c5-6c50-4875-9029-7829e05e8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7f58b-1d82-4206-9d25-667b57915abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Volume volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f (00bedbda-e6ec-4e46-9743-bf3126d6a49f): created successfully
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7f58b-1d82-4206-9d25-667b57915abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Flow 'volume_create_manager' (ddebc26d-2cb3-4208-908b-febe1b3d3b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:37:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7d22e5b2-0dc5-448b-beee-71f15637b144 tempest-VolumesAdminNegativeTest-729876450 None] Created volume successfully.
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Acquiring lock "cinder-00bedbda-e6ec-4e46-9743-bf3126d6a49f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "cinder-00bedbda-e6ec-4e46-9743-bf3126d6a49f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Acquiring lock "cinder-quobyte-00bedbda-e6ec-4e46-9743-bf3126d6a49f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "cinder-quobyte-00bedbda-e6ec-4e46-9743-bf3126d6a49f" acquired by "delete_volume" :: waited 0.032s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bff0c3-edca-4732-816c-9fd9339ee2a6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:37:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:34 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f
Sep 25 11:37:34 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:34 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f" returned: 0 in 0.809s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:34 devstack sudo[90300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f
Sep 25 11:37:34 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:35 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-00bedbda-e6ec-4e46-9743-bf3126d6a49f" returned: 0 in 0.377s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "cinder-quobyte-00bedbda-e6ec-4e46-9743-bf3126d6a49f" released by "delete_volume" :: held 1.305s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Created reservations ['c5f8d491-950a-4f2d-a9e4-7b7c4bc0cc36', '85044e3c-8190-43ca-9ea4-e4472269ee2f', '268b4045-e333-477b-b134-b7d70993cd80', '62ada032-ba59-42f1-8c5c-42e3de762596'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:35 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:37:35 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:35 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:37:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Deleted volume successfully.
Sep 25 11:37:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ae89179c-b38d-4d2d-aa16-64f85cdc0053 tempest-VolumesAdminNegativeTest-729876450 None] Lock "cinder-00bedbda-e6ec-4e46-9743-bf3126d6a49f-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=43,cinder:SELECT=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=44,cinder:SELECT=30,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (be2d809c-3eff-4225-a100-7fb6e4b0f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a915e39-d8af-4bd1-8567-b7abbd954a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a915e39-d8af-4bd1-8567-b7abbd954a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-774780024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b46acd-0d77-40e4-8ca8-41ef1adcbdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:46Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2addd374-d09a-412f-a4f9-b2c630d19341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2addd374-d09a-412f-a4f9-b2c630d19341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e179ca-d4f5-4a0c-9a66-dfa8d26b525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e179ca-d4f5-4a0c-9a66-dfa8d26b525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b46acd-0d77-40e4-8ca8-41ef1adcbdb3', 'volume_name': 'volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8791183-0c25-46aa-8135-3b9a7fd0ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8791183-0c25-46aa-8135-3b9a7fd0ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7fb153-08af-48c8-ac6d-b8ce9abda829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:46 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Volume 17b46acd-0d77-40e4-8ca8-41ef1adcbdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3', 'volume_size': 1}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-774780024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b46acd-0d77-40e4-8ca8-41ef1adcbdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:46Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Creating volume 17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:37:46 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:46 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 1073741824
Sep 25 11:37:46 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:46 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 1073741824" returned: 0 in 0.697s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:46 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3
Sep 25 11:37:46 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:47 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" returned: 0 in 0.338s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7fb153-08af-48c8-ac6d-b8ce9abda829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6a087d-39af-4639-a4a6-774b51174a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:37:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Volume volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 (17b46acd-0d77-40e4-8ca8-41ef1adcbdb3): created successfully
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6a087d-39af-4639-a4a6-774b51174a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:37:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (be2d809c-3eff-4225-a100-7fb6e4b0f214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:37:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d5d80c67-0855-4f6f-b12c-55fbdcb73065 tempest-AttachVolumeTestJSON-1940396537 None] Created volume successfully.
Sep 25 11:37:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7b0b915b-58c0-4ffb-a030-e5d0c635c1c0 req-35f70456-251e-4b8e-a670-20eefa53ef2b tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7b0b915b-58c0-4ffb-a030-e5d0c635c1c0 req-35f70456-251e-4b8e-a670-20eefa53ef2b tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7b0b915b-58c0-4ffb-a030-e5d0c635c1c0 req-35f70456-251e-4b8e-a670-20eefa53ef2b tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-7b0b915b-58c0-4ffb-a030-e5d0c635c1c0 req-35f70456-251e-4b8e-a670-20eefa53ef2b tempest-AttachVolumeTestJSON-1940396537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2fca4b7-38b8-4f92-9646-831d61e2d448', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:37:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-7b0b915b-58c0-4ffb-a030-e5d0c635c1c0 req-35f70456-251e-4b8e-a670-20eefa53ef2b tempest-AttachVolumeTestJSON-1940396537 None] attachment_update completed successfully.
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:37:51 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:37:51 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:37:51 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 8 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:37:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:37:59 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:37:59 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Flow 'volume_create_manager' (a15ffb02-6897-44ea-be32-65affb44ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce96389-b297-438e-b104-35122231b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce96389-b297-438e-b104-35122231b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1165926874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2f6d11-e271-43b7-a350-748b18dc4f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506d9ba54704391af58da5a45a09bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:00Z,use_quota=True,user_id='aa1d435db6d0435da5d77251754129b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd336747-cd45-47f4-9b2f-4e9183506527),volume_type_id=fd336747-cd45-47f4-9b2f-4e9183506527)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f5b22d-450c-42ed-a817-e96616cf3ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f5b22d-450c-42ed-a817-e96616cf3ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd217210-3b1c-440e-8d97-efb77a33025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd217210-3b1c-440e-8d97-efb77a33025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2f6d11-e271-43b7-a350-748b18dc4f90', 'volume_name': 'volume-2f2f6d11-e271-43b7-a350-748b18dc4f90', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9e83fd-c534-443a-92d0-0a640dd4a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9e83fd-c534-443a-92d0-0a640dd4a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186e4606-61f9-4730-a673-5ca65da973dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Volume 2f2f6d11-e271-43b7-a350-748b18dc4f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2f6d11-e271-43b7-a350-748b18dc4f90', 'volume_size': 1}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1165926874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2f6d11-e271-43b7-a350-748b18dc4f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506d9ba54704391af58da5a45a09bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:00Z,use_quota=True,user_id='aa1d435db6d0435da5d77251754129b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd336747-cd45-47f4-9b2f-4e9183506527),volume_type_id=fd336747-cd45-47f4-9b2f-4e9183506527)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Creating volume 2f2f6d11-e271-43b7-a350-748b18dc4f90 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:38:00 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:38:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:00 devstack sudo[91365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 1073741824
Sep 25 11:38:00 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:01 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 1073741824" returned: 0 in 0.925s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:01 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90
Sep 25 11:38:01 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:01 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186e4606-61f9-4730-a673-5ca65da973dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2f6d11-e271-43b7-a350-748b18dc4f90', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f985e3bd-6b16-46d4-aa03-5532d3dae0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:01 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Volume volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 (2f2f6d11-e271-43b7-a350-748b18dc4f90): created successfully
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f985e3bd-6b16-46d4-aa03-5532d3dae0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Flow 'volume_create_manager' (a15ffb02-6897-44ea-be32-65affb44ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:38:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0b3e95b2-007c-4f8a-8fe6-9c33e5aa2bdf tempest-VolumeTypesAccessTest-1888161861 None] Created volume successfully.
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Acquiring lock "cinder-2f2f6d11-e271-43b7-a350-748b18dc4f90-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "cinder-2f2f6d11-e271-43b7-a350-748b18dc4f90-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Acquiring lock "cinder-quobyte-2f2f6d11-e271-43b7-a350-748b18dc4f90" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "cinder-quobyte-2f2f6d11-e271-43b7-a350-748b18dc4f90" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d116d465-6086-40f2-9d05-75577dca7fd2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:38:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:02 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90
Sep 25 11:38:02 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:03 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90" returned: 0 in 0.869s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:03 devstack sudo[91421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90
Sep 25 11:38:03 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:04 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f2f6d11-e271-43b7-a350-748b18dc4f90" returned: 0 in 0.698s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "cinder-quobyte-2f2f6d11-e271-43b7-a350-748b18dc4f90" released by "delete_volume" :: held 1.732s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:38:04 devstack cinder-volume[87358]: WARNING cinder.quota [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1660850029 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1660850029, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:38:04 devstack cinder-volume[87358]: WARNING cinder.quota [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1660850029 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1660850029, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Created reservations ['7b10530e-0db2-4d4f-bd84-9a114a84145d', '0507f474-4b8f-4ffd-8e76-7a20414526e3', 'db5e092b-52af-452f-9efa-bc247bd6caf3', 'a234c83a-9755-4659-b73f-271796ffb45c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:04 devstack sudo[91434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:38:04 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:05 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:05 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:38:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Deleted volume successfully.
Sep 25 11:38:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7d0c52fb-24d4-44be-8c50-524b7aa708c2 tempest-VolumeTypesAccessTest-1888161861 None] Lock "cinder-2f2f6d11-e271-43b7-a350-748b18dc4f90-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:38:14 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:38:15 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Flow 'volume_create_manager' (5bc85537-1a37-4df7-b0ce-6f40eb20e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ef4aa5-ee04-4cf8-8aca-f5052eb92ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ef4aa5-ee04-4cf8-8aca-f5052eb92ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-879590790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01f057-d498-467b-b058-be6e8d3c3aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0daccc499c04617bd984c946d553f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:29Z,use_quota=True,user_id='57deade80e3742e9b49d0b0dba89efeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857df320-573f-40f2-beae-2b93fcbe5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857df320-573f-40f2-beae-2b93fcbe5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f5c3e-599e-4186-9b14-812ba0a95197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f5c3e-599e-4186-9b14-812ba0a95197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c01f057-d498-467b-b058-be6e8d3c3aa1', 'volume_name': 'volume-5c01f057-d498-467b-b058-be6e8d3c3aa1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e23d0a-2518-4b18-8f7b-c18b42fc9917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e23d0a-2518-4b18-8f7b-c18b42fc9917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6482a57-ca06-4a29-b790-a80c41c68f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Volume 5c01f057-d498-467b-b058-be6e8d3c3aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c01f057-d498-467b-b058-be6e8d3c3aa1', 'volume_size': 1}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-879590790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01f057-d498-467b-b058-be6e8d3c3aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0daccc499c04617bd984c946d553f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:29Z,use_quota=True,user_id='57deade80e3742e9b49d0b0dba89efeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Creating volume 5c01f057-d498-467b-b058-be6e8d3c3aa1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:38:29 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:38:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:29 devstack sudo[91694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 1073741824
Sep 25 11:38:29 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:30 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 1073741824" returned: 0 in 1.170s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:30 devstack sudo[91704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1
Sep 25 11:38:30 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-8e7708ca-774f-4c5a-83cf-49c67937e9f7 req-9f298315-b5e8-424c-ab84-c9d9f3d9d870 tempest-AttachVolumeTestJSON-1940396537 None] Terminate volume connection completed successfully.
Sep 25 11:38:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-8e7708ca-774f-4c5a-83cf-49c67937e9f7 req-9f298315-b5e8-424c-ab84-c9d9f3d9d870 tempest-AttachVolumeTestJSON-1940396537 None] Deleting attachment a2fca4b7-38b8-4f92-9646-831d61e2d448. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:38:31 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1" returned: 0 in 0.847s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6482a57-ca06-4a29-b790-a80c41c68f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c01f057-d498-467b-b058-be6e8d3c3aa1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf76b5b-3d83-4402-bf22-d8af8685ee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:38:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Volume volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 (5c01f057-d498-467b-b058-be6e8d3c3aa1): created successfully
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf76b5b-3d83-4402-bf22-d8af8685ee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:38:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Flow 'volume_create_manager' (5bc85537-1a37-4df7-b0ce-6f40eb20e549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:38:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9b762072-d56f-4d2f-a863-102a85a6006d tempest-ServerRescueNegativeTestJSON-1031449560 None] Created volume successfully.
Sep 25 11:38:46 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:38:46 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:51 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:38:51 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:52 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.630s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 8 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Acquiring lock "cinder-5c01f057-d498-467b-b058-be6e8d3c3aa1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "cinder-5c01f057-d498-467b-b058-be6e8d3c3aa1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Acquiring lock "cinder-quobyte-5c01f057-d498-467b-b058-be6e8d3c3aa1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "cinder-quobyte-5c01f057-d498-467b-b058-be6e8d3c3aa1" acquired by "delete_volume" :: waited 0.068s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[046510dd-88b9-45dd-ae51-6d5409ec7137]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:38:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:53 devstack sudo[92085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1
Sep 25 11:38:53 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:53 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1" returned: 0 in 1.029s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:54 devstack sudo[92093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1
Sep 25 11:38:54 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:54 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5c01f057-d498-467b-b058-be6e8d3c3aa1" returned: 0 in 0.960s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "cinder-quobyte-5c01f057-d498-467b-b058-be6e8d3c3aa1" released by "delete_volume" :: held 2.135s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Created reservations ['b2e7213a-f84a-4cab-a0c9-927e7c22712d', 'e90cd591-2d05-4a31-ad6b-130c39566ec9', 'c404a167-2c58-499e-8644-51c53589b159', 'c5371c73-7f50-4049-a79f-3ec81e9b4831'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:38:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:38:55 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:38:55 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:38:56 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Sep 25 11:38:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.628s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:38:56 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:38:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Deleted volume successfully.
Sep 25 11:38:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-518e497d-781b-46c8-bfe0-5d2c95523d72 tempest-ServerRescueNegativeTestJSON-1031449560 None] Lock "cinder-5c01f057-d498-467b-b058-be6e8d3c3aa1-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Flow 'volume_create_manager' (f60f5237-c39d-49fd-9cc5-ff348dde78fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00127601-409e-4c27-b71d-616950f6c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00127601-409e-4c27-b71d-616950f6c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2013827732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9f4cc3-f632-4699-aba7-1b5df057bdab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319d43cd08bf40cf87f6992d0c3d4d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:01Z,use_quota=True,user_id='5a2c95cd45e745ccb7dc43eb0273b6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57ce0a-6536-4dc3-b96d-ecef1189700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57ce0a-6536-4dc3-b96d-ecef1189700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb1684-dced-42d4-b819-b8c4ab880a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:01 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb1684-dced-42d4-b819-b8c4ab880a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b9f4cc3-f632-4699-aba7-1b5df057bdab', 'volume_name': 'volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65407a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdede7f7-4555-4c0b-b10e-cf2ce6d52dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdede7f7-4555-4c0b-b10e-cf2ce6d52dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca1fe4-54d7-44d2-b1c7-f26f003629b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65407a0>}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Trying to clone 8b9f4cc3-f632-4699-aba7-1b5df057bdab from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:39:03 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e59206-7b3a-4c47-9296-b588c7ab7ba8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:03 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD
Sep 25 11:39:03 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:04 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:04 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 is fetched for user 5a2c95cd45e745ccb7dc43eb0273b6f4. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:39:04 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d33fce1-9ea1-4a6b-89f1-60020d637f37]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:04 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD
Sep 25 11:39:04 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:05 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2013827732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9f4cc3-f632-4699-aba7-1b5df057bdab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319d43cd08bf40cf87f6992d0c3d4d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:01Z,use_quota=True,user_id='5a2c95cd45e745ccb7dc43eb0273b6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Creating volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:05 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:05 devstack sudo[92297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1073741824
Sep 25 11:39:05 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:06 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1073741824" returned: 0 in 0.939s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:06 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab
Sep 25 11:39:06 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:06 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab" returned: 0 in 0.375s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Attempting download of 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[21536aec-fd55-41c0-87ad-a4661b2cf295]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:07 devstack sudo[92311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g
Sep 25 11:39:07 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:07 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g" returned: 0 in 0.548s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:07 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g
Sep 25 11:39:07 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:08 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g" returned: 1 in 0.636s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_cjpk573g' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2acbe2-8c87-44a1-af55-f27a833b865d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:08 devstack sudo[92319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD
Sep 25 11:39:08 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:08 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] 5646eeca-3c92-4e68-971d-05dbb021a3a9 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:39:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:08 devstack sudo[92324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab
Sep 25 11:39:08 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:11 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab" returned: 0 in 3.244s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:11 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_dhh61wx7devstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:39:11 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Converted 112.00 MB image at 34.52 MB/s
Sep 25 11:39:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:11 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1G
Sep 25 11:39:11 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:12 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab 1G" returned: 0 in 0.646s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Downloaded image 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 for user 5a2c95cd45e745ccb7dc43eb0273b6f4 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Marking volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Copying metadata from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 to 8b9f4cc3-f632-4699-aba7-1b5df057bdab. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Creating volume glance metadata for volume 8b9f4cc3-f632-4699-aba7-1b5df057bdab backed by image 5646eeca-3c92-4e68-971d-05dbb021a3a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca1fe4-54d7-44d2-b1c7-f26f003629b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65407a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c150e6-31e9-492b-8f65-e128e535e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Volume volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab (8b9f4cc3-f632-4699-aba7-1b5df057bdab): created successfully
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c150e6-31e9-492b-8f65-e128e535e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Flow 'volume_create_manager' (f60f5237-c39d-49fd-9cc5-ff348dde78fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6b5b1ebc-65d2-4078-a7e4-53d964cb7e9d tempest-VolumesImageMetadata-1123285432 None] Created volume successfully.
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Acquiring lock "cinder-8b9f4cc3-f632-4699-aba7-1b5df057bdab-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "cinder-8b9f4cc3-f632-4699-aba7-1b5df057bdab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Acquiring lock "cinder-quobyte-8b9f4cc3-f632-4699-aba7-1b5df057bdab" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "cinder-quobyte-8b9f4cc3-f632-4699-aba7-1b5df057bdab" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b5e92-ac34-48db-bbac-5799ce0997c8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:14 devstack sudo[92374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab
Sep 25 11:39:14 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:15 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab" returned: 0 in 0.914s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:15 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab
Sep 25 11:39:15 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:15 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9f4cc3-f632-4699-aba7-1b5df057bdab" returned: 0 in 0.399s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "cinder-quobyte-8b9f4cc3-f632-4699-aba7-1b5df057bdab" released by "delete_volume" :: held 1.403s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Created reservations ['37452a1a-152b-4f41-b465-e0d2e786c447', '160d1d30-4682-45aa-a811-8ec664c39b0a', 'a8eaab2c-b3c8-4f9c-9cd1-49e7da9c4bff', '89c41d9b-f35f-4d80-84eb-eb10d869c586'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:16 devstack sudo[92384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:16 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:16 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.405s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Deleted volume successfully.
Sep 25 11:39:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4040c3a0-ea1f-4a58-a3f6-e8eafe5cc9ff tempest-VolumesImageMetadata-1123285432 None] Lock "cinder-8b9f4cc3-f632-4699-aba7-1b5df057bdab-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Flow 'volume_create_manager' (a191684d-6fe4-43fc-b7be-649017153935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7802ad87-7331-4ac5-ae76-ef1479e35d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7802ad87-7331-4ac5-ae76-ef1479e35d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-524377164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa8367-8275-4812-894d-5b7b92e5720b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='073e9c16fcb54213a6de59461058b1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:20Z,use_quota=True,user_id='8e9feb655f5447bfb18847c047a82883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22977471-f9d8-4780-ab70-9ee675311f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22977471-f9d8-4780-ab70-9ee675311f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41a064f-c0c2-498d-9bf3-94a18f41f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41a064f-c0c2-498d-9bf3-94a18f41f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfa8367-8275-4812-894d-5b7b92e5720b', 'volume_name': 'volume-bcfa8367-8275-4812-894d-5b7b92e5720b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7c824-2ff1-42fc-ac64-3dc9b0f233ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7c824-2ff1-42fc-ac64-3dc9b0f233ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8002c8a-aa4d-40f2-a24c-7b938a2c8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Volume bcfa8367-8275-4812-894d-5b7b92e5720b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfa8367-8275-4812-894d-5b7b92e5720b', 'volume_size': 1}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-524377164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa8367-8275-4812-894d-5b7b92e5720b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='073e9c16fcb54213a6de59461058b1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:20Z,use_quota=True,user_id='8e9feb655f5447bfb18847c047a82883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Creating volume bcfa8367-8275-4812-894d-5b7b92e5720b {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:20 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:20 devstack sudo[92405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b 1073741824
Sep 25 11:39:20 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:21 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b 1073741824" returned: 0 in 0.579s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:21 devstack sudo[92411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b
Sep 25 11:39:21 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:21 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8002c8a-aa4d-40f2-a24c-7b938a2c8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfa8367-8275-4812-894d-5b7b92e5720b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20f82e3-7a18-42e0-8e42-01a51551c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Volume volume-bcfa8367-8275-4812-894d-5b7b92e5720b (bcfa8367-8275-4812-894d-5b7b92e5720b): created successfully
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20f82e3-7a18-42e0-8e42-01a51551c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Flow 'volume_create_manager' (a191684d-6fe4-43fc-b7be-649017153935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-b80a8c2e-7bcf-47a7-a1b7-6f929cb48250 req-d2584fed-0cb8-4df8-be69-87465d760a5e tempest-VolumesGetTestJSON-352788332 None] Created volume successfully.
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Acquiring lock "cinder-bcfa8367-8275-4812-894d-5b7b92e5720b-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "cinder-bcfa8367-8275-4812-894d-5b7b92e5720b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Acquiring lock "cinder-quobyte-bcfa8367-8275-4812-894d-5b7b92e5720b" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "cinder-quobyte-bcfa8367-8275-4812-894d-5b7b92e5720b" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17c7b6-2619-4c68-8d51-7ea504ac90c3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:23 devstack sudo[92419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b
Sep 25 11:39:23 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:24 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b" returned: 0 in 0.581s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:24 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b
Sep 25 11:39:24 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:24 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bcfa8367-8275-4812-894d-5b7b92e5720b" returned: 0 in 0.425s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "cinder-quobyte-bcfa8367-8275-4812-894d-5b7b92e5720b" released by "delete_volume" :: held 1.089s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.quota [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Created reservations ['1db68c9d-6599-46a3-92f6-12c976bbb882', 'e377e18c-a5e1-4f86-aa62-5018b3c3c8d5', 'cdd8652f-7a4e-4e56-bbbc-0dbd70ea82f7', 'f449dd03-ddbf-4645-8eea-19452586220b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:24 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:24 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Flow 'volume_create_manager' (4219b2c3-b5ed-499f-a57f-6226556b22da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b37184-a240-4a8f-b788-7a2f361d2950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b37184-a240-4a8f-b788-7a2f361d2950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387435967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de04abec-7b60-499a-9431-291bd94a0886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7f0e04e7e9408d892dccef7c47821a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:25Z,use_quota=True,user_id='0ebceaa5e41c48b68073993164872b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf03ab3-bf08-41b6-a163-e16c846a2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf03ab3-bf08-41b6-a163-e16c846a2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e02a4-7b59-46d8-8e45-69818b4f5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e02a4-7b59-46d8-8e45-69818b4f5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de04abec-7b60-499a-9431-291bd94a0886', 'volume_name': 'volume-de04abec-7b60-499a-9431-291bd94a0886', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd60bd-79df-44d7-a83e-2570bf6b49d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd60bd-79df-44d7-a83e-2570bf6b49d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3aa3f4b-336f-44ca-9c58-9165a4f89281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Volume de04abec-7b60-499a-9431-291bd94a0886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de04abec-7b60-499a-9431-291bd94a0886', 'volume_size': 1}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387435967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de04abec-7b60-499a-9431-291bd94a0886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7f0e04e7e9408d892dccef7c47821a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:25Z,use_quota=True,user_id='0ebceaa5e41c48b68073993164872b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Creating volume de04abec-7b60-499a-9431-291bd94a0886 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:24 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:24 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 1073741824
Sep 25 11:39:24 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:25 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.370s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG cinder.manager [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Deleted volume successfully.
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-21160f46-d68f-4111-bdc4-be0b52cf39ae req-fb1cb4d6-e99f-49cd-8b49-68d08f718691 tempest-VolumesGetTestJSON-352788332 None] Lock "cinder-bcfa8367-8275-4812-894d-5b7b92e5720b-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:25 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 1073741824" returned: 0 in 0.665s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:25 devstack sudo[92455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886
Sep 25 11:39:25 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:25 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3aa3f4b-336f-44ca-9c58-9165a4f89281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de04abec-7b60-499a-9431-291bd94a0886', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f367ab-a3ed-4c87-b918-4c32ef996316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Volume volume-de04abec-7b60-499a-9431-291bd94a0886 (de04abec-7b60-499a-9431-291bd94a0886): created successfully
Sep 25 11:39:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f367ab-a3ed-4c87-b918-4c32ef996316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Flow 'volume_create_manager' (4219b2c3-b5ed-499f-a57f-6226556b22da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-94d94990-b9d3-4286-8ddf-9f0f6ae9f528 tempest-VolumesTransfersTest-17078445 None] Created volume successfully.
Sep 25 11:39:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-03ceb952-7469-4bd7-920a-f97f791a752d tempest-VolumesTransfersTest-1891045620 None] Transfer volume completed successfully.
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Acquiring lock "cinder-de04abec-7b60-499a-9431-291bd94a0886-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "cinder-de04abec-7b60-499a-9431-291bd94a0886-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Acquiring lock "cinder-quobyte-de04abec-7b60-499a-9431-291bd94a0886" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "cinder-quobyte-de04abec-7b60-499a-9431-291bd94a0886" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468f8b0-27e4-4e67-b5fa-137b7db0ea72]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:30 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886
Sep 25 11:39:30 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Flow 'volume_create_manager' (049ef027-3f38-4bd5-9a08-ea7ad3a73c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c475ec6d-cbae-452d-96a8-8a645768ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c475ec6d-cbae-452d-96a8-8a645768ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1443099917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58594d5b-7622-4e45-a375-48692f134a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4787e7f82944ab986211d1ebcc218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:31Z,use_quota=True,user_id='d1aa9342035b4a71adf1c8b881b39d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d66ec3b-7563-4dc1-925a-d92231bb08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d66ec3b-7563-4dc1-925a-d92231bb08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dc9f31-30e4-4511-b122-aadca29bdf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dc9f31-30e4-4511-b122-aadca29bdf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58594d5b-7622-4e45-a375-48692f134a4b', 'volume_name': 'volume-58594d5b-7622-4e45-a375-48692f134a4b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915fe1ae-3143-41be-9049-bc7f57c35f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915fe1ae-3143-41be-9049-bc7f57c35f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7cc45-f377-4fc7-9084-2827eb487d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Volume 58594d5b-7622-4e45-a375-48692f134a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58594d5b-7622-4e45-a375-48692f134a4b', 'volume_size': 1}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1443099917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58594d5b-7622-4e45-a375-48692f134a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4787e7f82944ab986211d1ebcc218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:31Z,use_quota=True,user_id='d1aa9342035b4a71adf1c8b881b39d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Creating volume 58594d5b-7622-4e45-a375-48692f134a4b {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:31 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:31 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b 1073741824
Sep 25 11:39:31 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:31 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886" returned: 0 in 1.074s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:31 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886
Sep 25 11:39:31 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:32 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-de04abec-7b60-499a-9431-291bd94a0886" returned: 0 in 0.637s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "cinder-quobyte-de04abec-7b60-499a-9431-291bd94a0886" released by "delete_volume" :: held 1.822s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Created reservations ['28c76983-70a9-416a-906b-c8d466687d12', '91571312-a222-43fb-ad5d-23e054eb9183', '1d81981f-39ef-4f7f-a45a-97310cf8f512', '4816b754-98e4-46e4-92df-6f8a567c75d4'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:32 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:32 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:32 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b 1073741824" returned: 0 in 1.240s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:33 devstack sudo[92565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b
Sep 25 11:39:33 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:33 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.566s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Deleted volume successfully.
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-19d3743e-a3ca-41c7-beaa-af086b413452 tempest-VolumesTransfersTest-742975534 None] Lock "cinder-de04abec-7b60-499a-9431-291bd94a0886-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:33 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b" returned: 0 in 0.444s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7cc45-f377-4fc7-9084-2827eb487d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58594d5b-7622-4e45-a375-48692f134a4b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153197c1-5c72-4d05-b541-3a8785d3ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:33 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Volume volume-58594d5b-7622-4e45-a375-48692f134a4b (58594d5b-7622-4e45-a375-48692f134a4b): created successfully
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153197c1-5c72-4d05-b541-3a8785d3ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Flow 'volume_create_manager' (049ef027-3f38-4bd5-9a08-ea7ad3a73c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0b5caef4-3a81-4f52-8154-ecdac0e06457 tempest-ServerActionsTestOtherA-197499957 None] Created volume successfully.
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Flow 'volume_create_manager' (d54306ef-485b-4384-8b19-70f2a222c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665b4305-6577-45b0-88d1-f730a219da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665b4305-6577-45b0-88d1-f730a219da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-525609422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563b95a2-3b8c-4cdb-842d-5cfc2201e7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7f0e04e7e9408d892dccef7c47821a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:34Z,use_quota=True,user_id='0ebceaa5e41c48b68073993164872b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da22d6c9-1715-442c-a7d6-90fca317aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da22d6c9-1715-442c-a7d6-90fca317aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35b2b7c-fe90-47c0-893e-2be937a501ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35b2b7c-fe90-47c0-893e-2be937a501ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563b95a2-3b8c-4cdb-842d-5cfc2201e7e1', 'volume_name': 'volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f505573c-20b2-423b-b8b4-4a40f696b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f505573c-20b2-423b-b8b4-4a40f696b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bdad0f-458e-4cef-838f-de7ca4a21439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:34 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Volume 563b95a2-3b8c-4cdb-842d-5cfc2201e7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1', 'volume_size': 1}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-525609422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563b95a2-3b8c-4cdb-842d-5cfc2201e7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7f0e04e7e9408d892dccef7c47821a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:34Z,use_quota=True,user_id='0ebceaa5e41c48b68073993164872b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Creating volume 563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:34 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:34 devstack sudo[92581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 1073741824
Sep 25 11:39:34 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:35 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 1073741824" returned: 0 in 0.940s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:35 devstack sudo[92597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1
Sep 25 11:39:35 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-372dc9c5-9b86-44d6-b49f-2628fe65b5eb tempest-GroupSnapshotsV319Test-1147085583 None] Group tempest-GroupSnapshotsV319Test-Group-1709648687: creating
Sep 25 11:39:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-372dc9c5-9b86-44d6-b49f-2628fe65b5eb tempest-GroupSnapshotsV319Test-1147085583 None] Group tempest-GroupSnapshotsV319Test-Group-1709648687: created successfully
Sep 25 11:39:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-372dc9c5-9b86-44d6-b49f-2628fe65b5eb tempest-GroupSnapshotsV319Test-1147085583 None] Create group completed successfully.
Sep 25 11:39:36 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" returned: 0 in 0.877s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bdad0f-458e-4cef-838f-de7ca4a21439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52999022-3082-4d63-bc2d-1c4652cfd389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Volume volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 (563b95a2-3b8c-4cdb-842d-5cfc2201e7e1): created successfully
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52999022-3082-4d63-bc2d-1c4652cfd389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Flow 'volume_create_manager' (d54306ef-485b-4384-8b19-70f2a222c92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-59e6a85e-ce05-4aaf-af82-ff1f1672aab5 tempest-VolumesTransfersTest-17078445 None] Created volume successfully.
Sep 25 11:39:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Acquiring lock "cinder-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "cinder-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Acquiring lock "cinder-quobyte-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "cinder-quobyte-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" acquired by "delete_volume" :: waited 0.092s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cae2b3-2ce9-4c49-8776-a1411dd7fd51]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Flow 'volume_create_manager' (d575c1f9-1f30-4e02-9c31-a5865f7b7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f6d7ff-cb02-4a12-93bf-214e2bab3f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f6d7ff-cb02-4a12-93bf-214e2bab3f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8267001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da234d33-5593-4809-9b45-405444ada8ed,host='devstack@QuobyteHD#QuobyteHD',id=a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6bcda51db1467098efd65afb035ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:39Z,use_quota=True,user_id='8ee9dd40e62342eba01d4d5f64f2d32d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b13cd6a-a7b3-4019-8575-3d5f6f41a8e7),volume_type_id=5b13cd6a-a7b3-4019-8575-3d5f6f41a8e7)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77af0488-01cf-4958-a927-647f48c8f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77af0488-01cf-4958-a927-647f48c8f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd440e70-0f95-4c22-96b3-1040b794f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd440e70-0f95-4c22-96b3-1040b794f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0', 'volume_name': 'volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2cfa29-7916-4965-9582-8d1a8da4836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2cfa29-7916-4965-9582-8d1a8da4836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8e61ff-28cf-4886-ae69-82cce230ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:39 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Volume a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0', 'volume_size': 1}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da234d33-5593-4809-9b45-405444ada8ed,created_at=2026-09-25T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8267001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da234d33-5593-4809-9b45-405444ada8ed,host='devstack@QuobyteHD#QuobyteHD',id=a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6bcda51db1467098efd65afb035ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:39Z,use_quota=True,user_id='8ee9dd40e62342eba01d4d5f64f2d32d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b13cd6a-a7b3-4019-8575-3d5f6f41a8e7),volume_type_id=5b13cd6a-a7b3-4019-8575-3d5f6f41a8e7)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Creating volume a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:39 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:39 devstack sudo[92641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 1073741824
Sep 25 11:39:39 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:39 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1
Sep 25 11:39:39 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:40 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" returned: 0 in 1.016s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:40 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1
Sep 25 11:39:40 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:40 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 1073741824" returned: 0 in 1.131s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:40 devstack sudo[92657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0
Sep 25 11:39:40 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:40 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" returned: 0 in 0.604s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "cinder-quobyte-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1" released by "delete_volume" :: held 1.696s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Created reservations ['4327bfae-fcb4-44da-8a90-27cb5e54a4bd', 'c084a9b0-1119-4485-a297-a9264a7d9dca', '895a185d-6558-4661-9aac-cb498baa59d9', '7f33cb2b-96ec-438a-bc3b-41c6e9bc8290'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:40 devstack sudo[92660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:40 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:40 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" returned: 0 in 0.443s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8e61ff-28cf-4886-ae69-82cce230ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee45eb04-a0b8-40ba-a6ae-15712b3dbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:41 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Volume volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 (a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0): created successfully
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee45eb04-a0b8-40ba-a6ae-15712b3dbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Flow 'volume_create_manager' (d575c1f9-1f30-4e02-9c31-a5865f7b7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-38794c62-4a05-47ac-9005-e183174f93f4 tempest-GroupSnapshotsV319Test-1147085583 None] Created volume successfully.
Sep 25 11:39:41 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.638s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Deleted volume successfully.
Sep 25 11:39:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-95302b76-07cc-41a4-880e-c499514948ba tempest-VolumesTransfersTest-742975534 None] Lock "cinder-563b95a2-3b8c-4cdb-842d-5cfc2201e7e1-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] GroupSnapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: creating.
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Group snapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: creating. {{(pid=87358) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Creating offline snapshot 67a7d94c-535b-4707-80f1-2aba69041179 of volume a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e3520-b938-4271-a6f6-f5c59cf1d848]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:42 devstack sudo[92678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0
Sep 25 11:39:42 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:43 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" returned: 0 in 0.658s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:43 devstack sudo[92685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 1G
Sep 25 11:39:43 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:43 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 1G" returned: 0 in 0.599s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:43 devstack sudo[92691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179
Sep 25 11:39:43 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:44 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179" returned: 0 in 0.493s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:44 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:39:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:44 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179
Sep 25 11:39:44 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:44 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:44 devstack sudo[92700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info
Sep 25 11:39:44 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:45 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info" returned: 0 in 0.442s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:45 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:39:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:45 devstack sudo[92703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info
Sep 25 11:39:45 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:45 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.info" returned: 0 in 0.579s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:46 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-16cf4958-5697-4da8-a319-93730ba31613 tempest-GroupSnapshotsV319Test-1147085583 None] group_snapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: created successfully
Sep 25 11:39:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] group_snapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: deleting
Sep 25 11:39:47 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=51,cinder:UPDATE=55,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:39:47 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=55,cinder:INSERT=19,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:39:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] group_snapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: deleting {{(pid=87358) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 11:39:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "cinder-quobyte-67a7d94c-535b-4707-80f1-2aba69041179" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-67a7d94c-535b-4707-80f1-2aba69041179" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Deleting offline snapshot 67a7d94c-535b-4707-80f1-2aba69041179 of volume a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] snapshot_file for this snap is: volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae4c87d-1f1b-4355-a498-b98645195c8b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:48 devstack sudo[92760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179
Sep 25 11:39:48 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:48 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe8a34-b7f7-40cf-bd3f-20fd43f840f7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:48 devstack sudo[92781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0
Sep 25 11:39:48 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:49 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" returned: 0 in 0.551s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:49 devstack sudo[92796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179
Sep 25 11:39:49 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:49 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179" returned: 0 in 0.492s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:49 devstack sudo[92801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179
Sep 25 11:39:49 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:50 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0.67a7d94c-535b-4707-80f1-2aba69041179" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-67a7d94c-535b-4707-80f1-2aba69041179" released by "_delete_snapshot" :: held 2.305s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" released by "delete_snapshot" :: held 2.370s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:50 devstack cinder-volume[87358]: WARNING cinder.quota [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691106650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691106650, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:39:50 devstack cinder-volume[87358]: WARNING cinder.quota [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691106650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691106650, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:39:50 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] Created reservations ['b2ffb5eb-9764-400e-86eb-8ed228400168', '6eee0d2c-a788-4bff-bb8e-b135d6bce645', 'a8e7d83b-50cd-4392-93f5-ee351be3c4c7', '8ef03d3d-3370-465f-8722-d3ed18679174'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ef53ec76-ff8b-47d6-b798-06cd987ac65d tempest-GroupSnapshotsV319Test-1147085583 None] group_snapshot d6f1ea0f-c67c-4ea5-a265-b1cdb153b8e4: deleted successfully
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:51 devstack sudo[92806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:51 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:51 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:39:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bbc371-c820-42f6-9ab0-18d846ab1575]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:52 devstack sudo[92809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0
Sep 25 11:39:52 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:52 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" returned: 0 in 0.677s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:52 devstack sudo[92814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0
Sep 25 11:39:52 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:53 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" returned: 0 in 0.669s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Lock "cinder-quobyte-a6d8fbe7-21ab-4c9d-ad99-0e3f33467cc0" released by "delete_volume" :: held 1.489s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:39:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Created reservations ['9c52890d-e9b7-483e-b714-01952cc42e30'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:53 devstack cinder-volume[87358]: WARNING cinder.quota [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1691106650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1691106650, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:39:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Created reservations ['a8f9bfb3-f8fb-424f-8add-d6ae1122e54f', 'c9404308-6ce1-4264-affa-f5a6c818c5d4', 'c69de331-9ffe-4c13-b919-6781d57fad0d', '5321a3d2-b25b-40ea-9056-6523970b6446'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:54 devstack sudo[92818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:39:54 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:54 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.597s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:54 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:39:54 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9a0fb517-9eca-4236-988a-3582ae10f60e tempest-GroupSnapshotsV319Test-1147085583 None] Delete group completed successfully.
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Flow 'volume_create_manager' (08d47926-cc66-467e-9ce4-2c15afbd48d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f94a9-8b71-44a2-adab-20ad8ea45352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f94a9-8b71-44a2-adab-20ad8ea45352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1209016150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb77cf2-535f-46f6-bed6-445abc9c6709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ede85dcd4e4f95ae9b598e6d747fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:58Z,use_quota=True,user_id='7c82810a30a74c17bc99fa4851261fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfe18f4-ef99-407b-941a-bbc1c539d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfe18f4-ef99-407b-941a-bbc1c539d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec707eb6-b0e1-4174-a41d-c01bbf26e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec707eb6-b0e1-4174-a41d-c01bbf26e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb77cf2-535f-46f6-bed6-445abc9c6709', 'volume_name': 'volume-6eb77cf2-535f-46f6-bed6-445abc9c6709', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ae805e-3970-4de3-a3b8-42fa43a4ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ae805e-3970-4de3-a3b8-42fa43a4ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31151ea-b1b6-4f0b-8731-0aa2f0642bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Volume 6eb77cf2-535f-46f6-bed6-445abc9c6709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb77cf2-535f-46f6-bed6-445abc9c6709', 'volume_size': 1}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1209016150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb77cf2-535f-46f6-bed6-445abc9c6709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ede85dcd4e4f95ae9b598e6d747fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:58Z,use_quota=True,user_id='7c82810a30a74c17bc99fa4851261fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Creating volume 6eb77cf2-535f-46f6-bed6-445abc9c6709 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:57 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:58 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 1073741824
Sep 25 11:39:58 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (56d62ad7-89fa-4b13-a5d5-de56205872d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e3ce2-38b4-4783-88ff-e0a194212b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e3ce2-38b4-4783-88ff-e0a194212b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-192164933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216c2250-1d49-40b2-88e0-6e242f5b4943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:58Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0328dce4-e254-4346-9ad1-210d1f3e986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0328dce4-e254-4346-9ad1-210d1f3e986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b7550-1f09-459c-9be5-d44fe51ecc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b7550-1f09-459c-9be5-d44fe51ecc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216c2250-1d49-40b2-88e0-6e242f5b4943', 'volume_name': 'volume-216c2250-1d49-40b2-88e0-6e242f5b4943', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4829cdf4-6fc5-4864-aeeb-a4eefad33159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4829cdf4-6fc5-4864-aeeb-a4eefad33159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd24e1bf-ec9d-4ac3-987e-5efe78b56f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Volume 216c2250-1d49-40b2-88e0-6e242f5b4943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216c2250-1d49-40b2-88e0-6e242f5b4943', 'volume_size': 1}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:58 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 1073741824" returned: 0 in 0.654s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:58 devstack sudo[92832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709
Sep 25 11:39:58 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:58 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709" returned: 0 in 0.285s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-192164933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216c2250-1d49-40b2-88e0-6e242f5b4943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:58Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Creating volume 216c2250-1d49-40b2-88e0-6e242f5b4943 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:39:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:39:59 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:59 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 1073741824
Sep 25 11:39:59 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31151ea-b1b6-4f0b-8731-0aa2f0642bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb77cf2-535f-46f6-bed6-445abc9c6709', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cab82a9-bf4e-43cd-947d-56612d9bd747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:39:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Volume volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 (6eb77cf2-535f-46f6-bed6-445abc9c6709): created successfully
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cab82a9-bf4e-43cd-947d-56612d9bd747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Flow 'volume_create_manager' (08d47926-cc66-467e-9ce4-2c15afbd48d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:39:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ec060869-c6dc-474f-a8c8-26955f2f5ab3 tempest-VolumesTransfersV355Test-189263280 None] Created volume successfully.
Sep 25 11:39:59 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 1073741824" returned: 0 in 0.748s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:39:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:39:59 devstack sudo[92841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943
Sep 25 11:39:59 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:00 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943" returned: 0 in 0.415s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd24e1bf-ec9d-4ac3-987e-5efe78b56f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216c2250-1d49-40b2-88e0-6e242f5b4943', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec5ecd1-b6f4-4562-88f4-480dc205d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Volume volume-216c2250-1d49-40b2-88e0-6e242f5b4943 (216c2250-1d49-40b2-88e0-6e242f5b4943): created successfully
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec5ecd1-b6f4-4562-88f4-480dc205d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (56d62ad7-89fa-4b13-a5d5-de56205872d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-431cab84-2af1-4f63-8119-5b95bb6097c8 tempest-AttachVolumeTestJSON-1940396537 None] Created volume successfully.
Sep 25 11:40:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7d0e9fe7-40b0-483f-85d3-cfbe9af20c73 tempest-VolumesTransfersV355Test-1444282677 None] Transfer volume completed successfully.
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "cinder-6eb77cf2-535f-46f6-bed6-445abc9c6709-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-6eb77cf2-535f-46f6-bed6-445abc9c6709-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "cinder-quobyte-6eb77cf2-535f-46f6-bed6-445abc9c6709" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-quobyte-6eb77cf2-535f-46f6-bed6-445abc9c6709" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6404cc-b1c9-41c8-b705-fae7a051fbf9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:02 devstack sudo[92848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709
Sep 25 11:40:02 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:03 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709" returned: 0 in 0.654s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:03 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709
Sep 25 11:40:03 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-81738918-5de4-4755-9cb7-35cc616d7af2 req-922728d6-c4f0-469d-86ad-5c6e8db7dec6 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-81738918-5de4-4755-9cb7-35cc616d7af2 req-922728d6-c4f0-469d-86ad-5c6e8db7dec6 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-81738918-5de4-4755-9cb7-35cc616d7af2 req-922728d6-c4f0-469d-86ad-5c6e8db7dec6 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:03 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-81738918-5de4-4755-9cb7-35cc616d7af2 req-922728d6-c4f0-469d-86ad-5c6e8db7dec6 tempest-AttachVolumeTestJSON-1940396537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-216c2250-1d49-40b2-88e0-6e242f5b4943', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9b9d3b1-f37a-4ee3-88cb-db89bc5f1493', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6eb77cf2-535f-46f6-bed6-445abc9c6709" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-quobyte-6eb77cf2-535f-46f6-bed6-445abc9c6709" released by "delete_volume" :: held 1.224s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-81738918-5de4-4755-9cb7-35cc616d7af2 req-922728d6-c4f0-469d-86ad-5c6e8db7dec6 tempest-AttachVolumeTestJSON-1940396537 None] attachment_update completed successfully.
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Created reservations ['bc61150b-3992-403c-85d8-54b3230369df', '33cfb5ce-1855-461c-9c9f-6fab8d695fdd', '7af36df4-6965-43f8-aecb-51e686f85c8c', '0eeb060d-72bf-42aa-96c6-9bc6345d0b1e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:03 devstack sudo[92869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:03 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:04 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.442s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:04 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Deleted volume successfully.
Sep 25 11:40:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aec13dc2-522e-42f2-901f-f5508999b270 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-6eb77cf2-535f-46f6-bed6-445abc9c6709-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Flow 'volume_create_manager' (038c20aa-9467-49e2-994c-d60574fec505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803bdab8-4ca5-4a74-9130-91f54ac536ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803bdab8-4ca5-4a74-9130-91f54ac536ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1772917249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74de2018-36d3-41ef-80ec-bc6633a4a0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ede85dcd4e4f95ae9b598e6d747fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:05Z,use_quota=True,user_id='7c82810a30a74c17bc99fa4851261fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedaed7e-8a18-487c-8330-41df4cb3d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedaed7e-8a18-487c-8330-41df4cb3d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02842c34-3b0f-48d3-94c7-19b653d55a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02842c34-3b0f-48d3-94c7-19b653d55a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74de2018-36d3-41ef-80ec-bc6633a4a0b2', 'volume_name': 'volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6910c38b-aeaa-4045-bd0c-d5608b82de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6910c38b-aeaa-4045-bd0c-d5608b82de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a8d43-770b-4b68-a892-ba25711a7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Volume 74de2018-36d3-41ef-80ec-bc6633a4a0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2', 'volume_size': 1}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1772917249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74de2018-36d3-41ef-80ec-bc6633a4a0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ede85dcd4e4f95ae9b598e6d747fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:05Z,use_quota=True,user_id='7c82810a30a74c17bc99fa4851261fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Creating volume 74de2018-36d3-41ef-80ec-bc6633a4a0b2 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:40:05 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:40:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:05 devstack sudo[93321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 1073741824
Sep 25 11:40:05 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (cb0a5745-cc6a-40c1-937c-bdf4b8663ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1ae7e-06ce-4a91-b0d6-0bef5ade176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1ae7e-06ce-4a91-b0d6-0bef5ade176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1881240476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675e44d0-2e14-493f-bcfa-6cb556d133ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:06Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aeb3a5-ec8a-4526-b395-1a58d4b7ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aeb3a5-ec8a-4526-b395-1a58d4b7ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9f5eb2-5f79-45aa-b996-5c316d8bc706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9f5eb2-5f79-45aa-b996-5c316d8bc706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675e44d0-2e14-493f-bcfa-6cb556d133ac', 'volume_name': 'volume-675e44d0-2e14-493f-bcfa-6cb556d133ac', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c977ecd-4a8b-4026-9615-c97b8d80ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c977ecd-4a8b-4026-9615-c97b8d80ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8cd7a-065b-4c05-92ca-29f6ce3db444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Volume 675e44d0-2e14-493f-bcfa-6cb556d133ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675e44d0-2e14-493f-bcfa-6cb556d133ac', 'volume_size': 1}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 1073741824" returned: 0 in 0.674s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:06 devstack sudo[93329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2
Sep 25 11:40:06 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:06 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1881240476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675e44d0-2e14-493f-bcfa-6cb556d133ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2155e6c9a14a2c810b20c40537a904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:06Z,use_quota=True,user_id='1427be634c2747d39dde0f19b1f51dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Creating volume 675e44d0-2e14-493f-bcfa-6cb556d133ac {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:40:06 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a8d43-770b-4b68-a892-ba25711a7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7161331f-86c5-44ea-9b78-14ea3a62d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:06 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac 1073741824
Sep 25 11:40:06 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Volume volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 (74de2018-36d3-41ef-80ec-bc6633a4a0b2): created successfully
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7161331f-86c5-44ea-9b78-14ea3a62d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Flow 'volume_create_manager' (038c20aa-9467-49e2-994c-d60574fec505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bad10aef-e79b-4f66-a501-0aaf13b44b80 tempest-VolumesTransfersV355Test-189263280 None] Created volume successfully.
Sep 25 11:40:07 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac 1073741824" returned: 0 in 0.565s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:07 devstack sudo[93338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac
Sep 25 11:40:07 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:07 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8cd7a-065b-4c05-92ca-29f6ce3db444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675e44d0-2e14-493f-bcfa-6cb556d133ac', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faac1a2-1329-4531-9bcb-089bf4b79c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Volume volume-675e44d0-2e14-493f-bcfa-6cb556d133ac (675e44d0-2e14-493f-bcfa-6cb556d133ac): created successfully
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faac1a2-1329-4531-9bcb-089bf4b79c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Flow 'volume_create_manager' (cb0a5745-cc6a-40c1-937c-bdf4b8663ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-82de0d81-884b-4beb-a15a-1433da7401c1 tempest-AttachVolumeTestJSON-1940396537 None] Created volume successfully.
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "cinder-74de2018-36d3-41ef-80ec-bc6633a4a0b2-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-74de2018-36d3-41ef-80ec-bc6633a4a0b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "cinder-quobyte-74de2018-36d3-41ef-80ec-bc6633a4a0b2" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-quobyte-74de2018-36d3-41ef-80ec-bc6633a4a0b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab6d77-5c2a-41de-b0f6-96056495183e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:08 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2
Sep 25 11:40:08 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:08 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2" returned: 0 in 0.510s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:08 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2
Sep 25 11:40:08 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:08 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-74de2018-36d3-41ef-80ec-bc6633a4a0b2" returned: 0 in 0.303s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-quobyte-74de2018-36d3-41ef-80ec-bc6633a4a0b2" released by "delete_volume" :: held 0.869s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Created reservations ['31222dd9-e502-450c-84fe-2522ec1c90ea', '3937529f-e24a-4242-8969-fab7bdf5c4e4', '57a4111c-fdb9-4312-8a76-5f694bbbfcc7', 'd59bcf92-c573-4104-a85a-3eb4b3fbafe9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:09 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:09 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:09 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.345s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Deleted volume successfully.
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bb067b01-247f-4a4a-a7fc-fd1fa9ce2af3 tempest-VolumesTransfersV355Test-1414753474 None] Lock "cinder-74de2018-36d3-41ef-80ec-bc6633a4a0b2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5d84ea1d-b367-4212-aa95-63689f206877 req-609725d8-efe5-4d1d-b558-059d15d710dc tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5d84ea1d-b367-4212-aa95-63689f206877 req-609725d8-efe5-4d1d-b558-059d15d710dc tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5d84ea1d-b367-4212-aa95-63689f206877 req-609725d8-efe5-4d1d-b558-059d15d710dc tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-5d84ea1d-b367-4212-aa95-63689f206877 req-609725d8-efe5-4d1d-b558-059d15d710dc tempest-AttachVolumeTestJSON-1940396537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-675e44d0-2e14-493f-bcfa-6cb556d133ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '596dfff2-7e5d-4a40-a66a-f99c00c07ac4', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:40:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-5d84ea1d-b367-4212-aa95-63689f206877 req-609725d8-efe5-4d1d-b558-059d15d710dc tempest-AttachVolumeTestJSON-1940396537 None] attachment_update completed successfully.
Sep 25 11:40:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-2fa83435-caff-4b83-926c-58450cc6f5cb req-40838705-a432-4441-9053-8cf3a58a0362 tempest-AttachVolumeTestJSON-1940396537 None] Terminate volume connection completed successfully.
Sep 25 11:40:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-2fa83435-caff-4b83-926c-58450cc6f5cb req-40838705-a432-4441-9053-8cf3a58a0362 tempest-AttachVolumeTestJSON-1940396537 None] Deleting attachment f9b9d3b1-f37a-4ee3-88cb-db89bc5f1493. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:40:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9d680ea9-2c91-44c4-a62e-d2252683e538 tempest-GroupsV320Test-359915639 None] Group tempest-GroupsV320Test-Group-630023930: creating
Sep 25 11:40:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9d680ea9-2c91-44c4-a62e-d2252683e538 tempest-GroupsV320Test-359915639 None] Group tempest-GroupsV320Test-Group-630023930: created successfully
Sep 25 11:40:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9d680ea9-2c91-44c4-a62e-d2252683e538 tempest-GroupsV320Test-359915639 None] Create group completed successfully.
Sep 25 11:40:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-b3284645-217c-48b9-8aac-789a19f7ddf1 req-3fbd8cd0-3c00-4215-8a7d-239b8c6a8c18 tempest-AttachVolumeTestJSON-1940396537 None] Terminate volume connection completed successfully.
Sep 25 11:40:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b3284645-217c-48b9-8aac-789a19f7ddf1 req-3fbd8cd0-3c00-4215-8a7d-239b8c6a8c18 tempest-AttachVolumeTestJSON-1940396537 None] Deleting attachment 596dfff2-7e5d-4a40-a66a-f99c00c07ac4. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Created reservations ['635b07d8-c0fa-4ca7-8b82-d2cfd2d2f70c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:16 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:16 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:17 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ccc9413b-6d33-48ff-ba62-53b4f1abdfe8 tempest-GroupsV320Test-359915639 None] Delete group completed successfully.
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-f38d9443-71d8-4f66-83f3-995babff1979 req-c53558c7-bf2d-4299-8eee-d1f452a87171 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-f38d9443-71d8-4f66-83f3-995babff1979 req-c53558c7-bf2d-4299-8eee-d1f452a87171 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-f38d9443-71d8-4f66-83f3-995babff1979 req-c53558c7-bf2d-4299-8eee-d1f452a87171 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-f38d9443-71d8-4f66-83f3-995babff1979 req-c53558c7-bf2d-4299-8eee-d1f452a87171 tempest-ServerActionsTestOtherA-197499957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-58594d5b-7622-4e45-a375-48692f134a4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e55c17c4-0583-4e63-b6e4-e1cbb413945a', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:40:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-f38d9443-71d8-4f66-83f3-995babff1979 req-c53558c7-bf2d-4299-8eee-d1f452a87171 tempest-ServerActionsTestOtherA-197499957 None] attachment_update completed successfully.
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Flow 'volume_create_manager' (9c364f6c-79bd-4ad3-9251-e2a233e5c8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be825f19-89bd-4495-b3b8-e97754772e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be825f19-89bd-4495-b3b8-e97754772e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1202534898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dd4142-87b5-439b-ac95-0d6944f29854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c4d6e4dcf248f79f0c489ee23e5793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:21Z,use_quota=True,user_id='2eb941b3a1f44679949824fc4aeefbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acaa496-4848-40fd-b4b8-4fc479d795da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acaa496-4848-40fd-b4b8-4fc479d795da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e2abc-e5c9-4eed-acc4-f3c68ff97841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e2abc-e5c9-4eed-acc4-f3c68ff97841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3dd4142-87b5-439b-ac95-0d6944f29854', 'volume_name': 'volume-f3dd4142-87b5-439b-ac95-0d6944f29854', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7f3a2f-ca72-4c28-aad1-93ff60992296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7f3a2f-ca72-4c28-aad1-93ff60992296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4f136e-90c0-4a5c-b8b8-f6d1761ad4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Volume f3dd4142-87b5-439b-ac95-0d6944f29854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3dd4142-87b5-439b-ac95-0d6944f29854', 'volume_size': 1}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1202534898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dd4142-87b5-439b-ac95-0d6944f29854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c4d6e4dcf248f79f0c489ee23e5793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:21Z,use_quota=True,user_id='2eb941b3a1f44679949824fc4aeefbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Creating volume f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:40:20 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:40:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:20 devstack sudo[93873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 1073741824
Sep 25 11:40:20 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:21 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 1073741824" returned: 0 in 0.770s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:21 devstack sudo[93880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:21 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:22 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4f136e-90c0-4a5c-b8b8-f6d1761ad4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3dd4142-87b5-439b-ac95-0d6944f29854', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e587677-ff0b-428a-8675-ab0ebd5c6cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Volume volume-f3dd4142-87b5-439b-ac95-0d6944f29854 (f3dd4142-87b5-439b-ac95-0d6944f29854): created successfully
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e587677-ff0b-428a-8675-ab0ebd5c6cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Flow 'volume_create_manager' (9c364f6c-79bd-4ad3-9251-e2a233e5c8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f766cb91-e9c4-4de3-9bf3-1267bc0c2c99 tempest-VolumesCloneTest-1674714660 None] Created volume successfully.
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-675e44d0-2e14-493f-bcfa-6cb556d133ac-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-675e44d0-2e14-493f-bcfa-6cb556d133ac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-quobyte-675e44d0-2e14-493f-bcfa-6cb556d133ac" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-675e44d0-2e14-493f-bcfa-6cb556d133ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8b5c5-8f5e-425e-8d0c-cab20e5838ee]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:22 devstack sudo[93889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac
Sep 25 11:40:22 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-78d64a0e-1c67-484c-8558-749d5560b68b tempest-ServerActionsTestOtherA-197499957 None] Terminate volume connection completed successfully.
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-78d64a0e-1c67-484c-8558-749d5560b68b tempest-ServerActionsTestOtherA-197499957 None] Deleting attachment e55c17c4-0583-4e63-b6e4-e1cbb413945a. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:40:23 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac" returned: 0 in 0.663s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:23 devstack sudo[93925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac
Sep 25 11:40:23 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Flow 'volume_create_manager' (6c42f8d2-faaf-4cc2-b4b4-3714023d61a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b695d01d-e699-4c7b-a24d-c62b1eea8322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b695d01d-e699-4c7b-a24d-c62b1eea8322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-204302413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e115a68a-f135-40a2-b739-a5df2628cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c4d6e4dcf248f79f0c489ee23e5793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f3dd4142-87b5-439b-ac95-0d6944f29854,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:24Z,use_quota=True,user_id='2eb941b3a1f44679949824fc4aeefbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cbac79-2548-4725-a1a4-5571fe83f83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cbac79-2548-4725-a1a4-5571fe83f83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e5d704-8acf-4d7e-9c44-0b81a1994b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e5d704-8acf-4d7e-9c44-0b81a1994b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e115a68a-f135-40a2-b739-a5df2628cf78', 'volume_name': 'volume-e115a68a-f135-40a2-b739-a5df2628cf78', 'volume_size': 2, 'source_volid': 'f3dd4142-87b5-439b-ac95-0d6944f29854', 'source_volstatus': 'available'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:23 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fd5feb-992c-4270-aa5c-0b5518e5a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fd5feb-992c-4270-aa5c-0b5518e5a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499a378b-897b-4ff7-8ca0-5e7db881405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Volume e115a68a-f135-40a2-b739-a5df2628cf78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e115a68a-f135-40a2-b739-a5df2628cf78', 'volume_size': 2, 'source_volid': 'f3dd4142-87b5-439b-ac95-0d6944f29854', 'source_volstatus': 'available'}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-675e44d0-2e14-493f-bcfa-6cb556d133ac" returned: 0 in 0.609s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:23 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Cloning volume f3dd4142-87b5-439b-ac95-0d6944f29854 to volume e115a68a-f135-40a2-b739-a5df2628cf78
Sep 25 11:40:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-675e44d0-2e14-493f-bcfa-6cb556d133ac" released by "delete_volume" :: held 1.352s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Creating offline snapshot d2997902-a163-4bdc-92a0-ff9970ebe301 of volume f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeccf21f-e5f2-4d99-aa0c-b6568efdeb5f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Created reservations ['2339f60a-bb30-47c7-99de-681599399445', '08fa86d6-0adc-4da6-8289-67b14c86ca84', 'ef061645-7e3c-456a-8e13-3244f12e2238', '86a04e82-155a-471d-aa28-af4e9ada9dfc'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:24 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:24 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:24 devstack sudo[93954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:24 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-2d3bfcb7-d06d-453a-9c3f-2f03062e9543 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:24 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.690s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:24 devstack sudo[93965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 1G
Sep 25 11:40:24 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:24 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.516s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Deleted volume successfully.
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ed393b-1a49-45fa-8d39-f41969f017ed tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-675e44d0-2e14-493f-bcfa-6cb556d133ac-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-216c2250-1d49-40b2-88e0-6e242f5b4943-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-216c2250-1d49-40b2-88e0-6e242f5b4943-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-quobyte-216c2250-1d49-40b2-88e0-6e242f5b4943" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-216c2250-1d49-40b2-88e0-6e242f5b4943" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a3211-bd3a-42bb-84aa-005fee681de9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:25 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943
Sep 25 11:40:25 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:25 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 1G" returned: 0 in 0.665s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dd4142-87b5-439b-ac95-0d6944f29854 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:25 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dd4142-87b5-439b-ac95-0d6944f29854 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:25 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:25 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943" returned: 0 in 0.583s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:25 devstack sudo[93979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943
Sep 25 11:40:25 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:25 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dd4142-87b5-439b-ac95-0d6944f29854 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.446s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:25 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 is being set with open permissions: ugo+rw
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:25 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:25 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:25 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-216c2250-1d49-40b2-88e0-6e242f5b4943" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-216c2250-1d49-40b2-88e0-6e242f5b4943" released by "delete_volume" :: held 0.962s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Created reservations ['de97c8e4-81f7-4ac4-b34a-003476b29bcd', '8157c61d-ef7c-44c3-ad8d-1d19b309fdb0', '1eba5b6d-51e2-4e97-998a-6d5f2d9c83f9', '6b50562a-f141-4230-8b8e-28af18825652'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:26 devstack sudo[93987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:26 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:26 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.361s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:26 devstack sudo[93990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info
Sep 25 11:40:26 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:26 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.373s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Deleted volume successfully.
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cb34aede-0eed-489f-a6bb-d85b429216ce tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-216c2250-1d49-40b2-88e0-6e242f5b4943-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:26 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info" returned: 0 in 0.327s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:26 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info is being set with open permissions: ugo+rw
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:26 devstack sudo[93994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info
Sep 25 11:40:26 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:26 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.info" returned: 0 in 0.272s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] snapshot: d2997902-a163-4bdc-92a0-ff9970ebe301, volume: e115a68a-f135-40a2-b739-a5df2628cf78,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d9ed3-257c-4585-9396-e61f3bd775b4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:27 devstack sudo[93997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:27 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:27 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3dd4142-87b5-439b-ac95-0d6944f29854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd1adc3-dd7a-4df8-9f2c-95ce66f5b2f7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Flow 'volume_create_manager' (ed4cf0dd-02b7-4781-9378-f32e33894781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c0a44-bdf1-4d50-bb0b-898ab6efe742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:27 devstack sudo[94002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:27 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c0a44-bdf1-4d50-bb0b-898ab6efe742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-878946420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb8542b-883a-4bb0-ae58-f0b353f8d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6537507274ef445bbfb5a09b2f431d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:28Z,use_quota=True,user_id='0505d265551d4e56a657006ca83ad46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0056d01a-deaa-4766-8d25-5f56634ab022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0056d01a-deaa-4766-8d25-5f56634ab022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2180246c-241c-493e-b6cc-90c5224878c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2180246c-241c-493e-b6cc-90c5224878c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb8542b-883a-4bb0-ae58-f0b353f8d27b', 'volume_name': 'volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592abf23-9f52-4675-bfbc-d82ec27975d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592abf23-9f52-4675-bfbc-d82ec27975d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f3ab09-727a-409d-a021-81e5dcdc1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b', 'volume_size': 1}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "cinder-quobyte-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf445e-6db1-4a98-9603-ce61a949bce2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:28 devstack sudo[94004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3
Sep 25 11:40:28 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:28 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:28 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78
Sep 25 11:40:28 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:28 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" returned: 0 in 0.434s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:28 devstack sudo[94017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3
Sep 25 11:40:28 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:28 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" returned: 0 in 0.363s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-quobyte-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3" released by "delete_volume" :: held 0.864s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Created reservations ['f66133d0-b0ba-4631-9ffd-2187e60c0eaf', 'fbde2e68-c4eb-40a9-a773-2770919450b2', '39b04122-ccb0-4ef6-9443-bf5250e547e9', '3f0a4930-3d39-4e7a-b81f-1c8b5ae8cd20'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:29 devstack sudo[94027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:29 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:29 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.569s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:29 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Deleted volume successfully.
Sep 25 11:40:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-63101c92-b694-454d-b5ff-224838c25bf8 tempest-AttachVolumeTestJSON-1940396537 None] Lock "cinder-17b46acd-0d77-40e4-8ca8-41ef1adcbdb3-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:36 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78" returned: 0 in 8.149s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854, size 1024.00 MB, duration 8.15 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:40:36 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Converted 1024.00 MB image at 125.65 MB/s
Sep 25 11:40:36 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 is being set with open permissions: ugo+rw
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:36 devstack sudo[94046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78
Sep 25 11:40:36 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:36 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78" returned: 0 in 0.360s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" released by "_copy_volume_from_snapshot" :: held 9.600s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-quobyte-d2997902-a163-4bdc-92a0-ff9970ebe301" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-d2997902-a163-4bdc-92a0-ff9970ebe301" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Deleting offline snapshot d2997902-a163-4bdc-92a0-ff9970ebe301 of volume f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] snapshot_file for this snap is: volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e06ab3-4948-4453-8f79-43fb27500c8a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:36 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:36 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:37 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3dd4142-87b5-439b-ac95-0d6944f29854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4879130-ec01-4451-8915-45348cf57f8f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:37 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:37 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:37 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.728s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:37 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:37 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:38 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:38 devstack sudo[94065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301
Sep 25 11:40:38 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:38 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854.d2997902-a163-4bdc-92a0-ff9970ebe301" returned: 0 in 0.380s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-d2997902-a163-4bdc-92a0-ff9970ebe301" released by "_delete_snapshot" :: held 2.138s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.829s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-2d3bfcb7-d06d-453a-9c3f-2f03062e9543 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.184s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499a378b-897b-4ff7-8ca0-5e7db881405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e115a68a-f135-40a2-b739-a5df2628cf78', 'volume_size': 2, 'source_volid': 'f3dd4142-87b5-439b-ac95-0d6944f29854', 'source_volstatus': 'available'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b05fa6-9741-41ac-afa9-af682b7b74ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-2d3bfcb7-d06d-453a-9c3f-2f03062e9543 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.096s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-878946420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb8542b-883a-4bb0-ae58-f0b353f8d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6537507274ef445bbfb5a09b2f431d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:28Z,use_quota=True,user_id='0505d265551d4e56a657006ca83ad46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Creating volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:40:38 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:38 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Volume volume-e115a68a-f135-40a2-b739-a5df2628cf78 (e115a68a-f135-40a2-b739-a5df2628cf78): created successfully
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b05fa6-9741-41ac-afa9-af682b7b74ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Flow 'volume_create_manager' (6c42f8d2-faaf-4cc2-b4b4-3714023d61a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:38 devstack sudo[94068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b 1073741824
Sep 25 11:40:38 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-2d3bfcb7-d06d-453a-9c3f-2f03062e9543 tempest-ServerActionsTestOtherA-197499957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-58594d5b-7622-4e45-a375-48692f134a4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3acdcd6-86bc-4760-990e-fb6799176e97', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:40:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1f12b0bb-d54d-42da-96da-eebd3ceba165 tempest-VolumesCloneTest-1674714660 None] Created volume successfully.
Sep 25 11:40:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4f6f44b0-cba9-4a3b-96e9-6d65fdece1c2 req-2d3bfcb7-d06d-453a-9c3f-2f03062e9543 tempest-ServerActionsTestOtherA-197499957 None] attachment_update completed successfully.
Sep 25 11:40:39 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b 1073741824" returned: 0 in 0.671s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:39 devstack sudo[94077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b
Sep 25 11:40:39 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:39 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" returned: 0 in 0.425s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f3ab09-727a-409d-a021-81e5dcdc1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee2eb7-fdf1-4d7f-9ebd-e77a82d93fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:40:40 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Volume volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b (ecb8542b-883a-4bb0-ae58-f0b353f8d27b): created successfully
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee2eb7-fdf1-4d7f-9ebd-e77a82d93fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Flow 'volume_create_manager' (ed4cf0dd-02b7-4781-9378-f32e33894781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:40:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c117ac31-23dc-4973-90ad-c86612e85180 tempest-SnapshotsActionsTest-829575394 None] Created volume successfully.
Sep 25 11:40:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-e115a68a-f135-40a2-b739-a5df2628cf78-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "cinder-e115a68a-f135-40a2-b739-a5df2628cf78-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" acquired by "delete_volume" :: waited 0.049s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3a9f0-b02d-41db-9cf2-d6058efe75aa]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:41 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78
Sep 25 11:40:41 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Creating offline snapshot bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8cd928-2a58-4f22-be13-e6d8d7cd57aa]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:42 devstack sudo[94563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b
Sep 25 11:40:42 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:42 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78" returned: 0 in 1.072s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:42 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78
Sep 25 11:40:42 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:42 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" returned: 0 in 0.713s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:42 devstack sudo[94581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 1G
Sep 25 11:40:42 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:42 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e115a68a-f135-40a2-b739-a5df2628cf78" returned: 0 in 0.455s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-e115a68a-f135-40a2-b739-a5df2628cf78" released by "delete_volume" :: held 1.665s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:42 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Created reservations ['a8058c57-c76c-4f0b-b93f-4aeefcce32bd', '0769b49c-3b88-4e44-a091-68e601374a03', 'f416d453-5d70-46cc-98ac-6cb013db2f4c', '8ed0bac1-3708-46e4-804b-4fcd3447029c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:43 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:43 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:43 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 1G" returned: 0 in 0.770s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-f3dd4142-87b5-439b-ac95-0d6944f29854-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:43 devstack sudo[94606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:43 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-f3dd4142-87b5-439b-ac95-0d6944f29854-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "cinder-quobyte-f3dd4142-87b5-439b-ac95-0d6944f29854" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:43 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.568s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Deleted volume successfully.
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-f3dd4142-87b5-439b-ac95-0d6944f29854" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4cee0-acdc-4920-9153-d5661dc28cb6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-556d5c5e-f597-4862-a334-b3e739bd871d tempest-VolumesCloneTest-1674714660 None] Lock "cinder-e115a68a-f135-40a2-b739-a5df2628cf78-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10a8070d-f516-4040-9c1f-5b4907d00076 tempest-BackendsCapabilitiesAdminTestsJSON-1243613198 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4321403503418, 'free_capacity_gb': 1775.4321403503418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87358) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 11:40:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b6383f38-9c22-4485-8b82-0e6eef706c49 tempest-BackendsCapabilitiesAdminTestsJSON-1243613198 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4321403503418, 'free_capacity_gb': 1775.4321403503418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87358) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 11:40:44 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:44 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:44 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.531s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:44 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 is being set with open permissions: ugo+rw
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:44 devstack sudo[94624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:44 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:44 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.583s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:44 devstack sudo[94629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854
Sep 25 11:40:44 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:44 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.534s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:44 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info
Sep 25 11:40:44 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:44 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f3dd4142-87b5-439b-ac95-0d6944f29854" returned: 0 in 0.524s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-quobyte-f3dd4142-87b5-439b-ac95-0d6944f29854" released by "delete_volume" :: held 1.247s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:45 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:45 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info is being set with open permissions: ugo+rw
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Created reservations ['0641dcaa-7ae7-4b7d-94b0-f9639634bb92', '3d9e63b1-0348-41b5-a0a0-715b8028f481', '2c24719c-c2a8-4f2d-8da8-79cf0d9ef101', '04713a90-828b-471a-be1c-6ca7a1e4fb96'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:45 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info
Sep 25 11:40:45 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:45 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:45 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:45 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.info" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.610s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4dedb657-c04e-45c3-80af-251dd6f5a023 tempest-SnapshotsActionsTest-829575394 None] Create snapshot completed successfully
Sep 25 11:40:45 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.443s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Deleted volume successfully.
Sep 25 11:40:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0aef9468-1af6-4a8a-8b89-670df8177bf3 tempest-VolumesCloneTest-1674714660 None] Lock "cinder-f3dd4142-87b5-439b-ac95-0d6944f29854-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Creating offline snapshot b8f54585-2308-4c35-9111-d5f9d5351689 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:40:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[64496aa3-e5df-44a2-b291-fc7e0060facd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:47 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:47 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:48 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.642s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:48 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 1G
Sep 25 11:40:48 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:48 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 1G" returned: 0 in 0.754s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:48 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689
Sep 25 11:40:48 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:49 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:49 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 is being set with open permissions: ugo+rw
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:49 devstack sudo[94664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689
Sep 25 11:40:49 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:49 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=113,cinder:INSERT=21,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=104,cinder:UPDATE=109,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:40:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-901d70a7-ebd3-4f51-a0f1-1326e8a07666 tempest-SnapshotsActionsTest-829575394 None] Create snapshot completed successfully
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-b8f54585-2308-4c35-9111-d5f9d5351689-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-b8f54585-2308-4c35-9111-d5f9d5351689-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-b8f54585-2308-4c35-9111-d5f9d5351689" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-b8f54585-2308-4c35-9111-d5f9d5351689" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Deleting offline snapshot b8f54585-2308-4c35-9111-d5f9d5351689 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] snapshot_file for this snap is: volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7debd6-8719-4600-b466-41c88b6d2703]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:51 devstack sudo[94667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689
Sep 25 11:40:51 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:51 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:40:51 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:51 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689" returned: 0 in 0.576s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:51 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be85457-9cc4-4901-ad52-af6dd6a35a75]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.490s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:40:52 devstack sudo[94675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:52 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:52 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.684s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:52 devstack sudo[94680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689
Sep 25 11:40:52 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:53 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689" returned: 0 in 0.575s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:53 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689
Sep 25 11:40:53 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:53 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b8f54585-2308-4c35-9111-d5f9d5351689" returned: 0 in 0.425s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-b8f54585-2308-4c35-9111-d5f9d5351689" released by "_delete_snapshot" :: held 2.453s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_snapshot" :: held 2.501s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:53 devstack cinder-volume[87358]: WARNING cinder.quota [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:40:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Created reservations ['9c837054-3bec-43cc-9ec1-2e278c513131', '02fcfbf7-6dda-4029-8f69-8e93c67cbf4c', '4d51a605-3a8b-4dd2-a692-7cfd1c3c2be6', '2ea6fa37-4970-4d5c-8d33-acee736c8941'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:40:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Delete snapshot completed successfully.
Sep 25 11:40:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a8ccb20a-4fa5-4d4c-82f0-e407edc8988f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-b8f54585-2308-4c35-9111-d5f9d5351689-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:40:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:40:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:40:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Creating offline snapshot b43ce3a6-a2fc-4005-8327-e4df358552d6 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:40:55 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c234c8c2-a112-4394-ae2d-d24b0c228f90]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:55 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:55 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:56 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.810s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:56 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 1G
Sep 25 11:40:56 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:56 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 1G" returned: 0 in 0.872s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:56 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6
Sep 25 11:40:56 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:57 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6" returned: 0 in 0.672s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:57 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 is being set with open permissions: ugo+rw
Sep 25 11:40:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:57 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6
Sep 25 11:40:57 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:58 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6" returned: 0 in 0.412s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:40:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b57dc924-d414-4b2e-b66d-d93288fc2085 tempest-SnapshotsActionsTest-829575394 None] Create snapshot completed successfully
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-b43ce3a6-a2fc-4005-8327-e4df358552d6-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-b43ce3a6-a2fc-4005-8327-e4df358552d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-b43ce3a6-a2fc-4005-8327-e4df358552d6" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-b43ce3a6-a2fc-4005-8327-e4df358552d6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Deleting offline snapshot b43ce3a6-a2fc-4005-8327-e4df358552d6 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] snapshot_file for this snap is: volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabf723-5aa3-4778-bf33-edadd263884a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:58 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6
Sep 25 11:40:58 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:40:59 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Sep 25 11:40:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6" returned: 0 in 0.834s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:40:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:40:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e9d89-776c-431c-8b84-ff4ef1b98ae3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:40:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:40:59 devstack sudo[94748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:40:59 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:00 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.671s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:00 devstack sudo[94753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6
Sep 25 11:41:00 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:00 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6" returned: 0 in 0.609s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:00 devstack sudo[94783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6
Sep 25 11:41:00 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:01 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.b43ce3a6-a2fc-4005-8327-e4df358552d6" returned: 0 in 0.404s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-b43ce3a6-a2fc-4005-8327-e4df358552d6" released by "_delete_snapshot" :: held 2.718s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_snapshot" :: held 2.757s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:01 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Created reservations ['45fcafcb-7b03-433e-9504-b1af54a7da74', 'b0342a0e-d2a9-471d-afa7-31f59c73a978', '66b9b813-557a-4d81-a006-91465ed74db7', 'a0be4b1b-9b3d-47fb-9431-330f34b985d9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Delete snapshot completed successfully.
Sep 25 11:41:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25029f86-3c98-4f09-a8e0-1118d97dd9c4 tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-b43ce3a6-a2fc-4005-8327-e4df358552d6-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Creating offline snapshot 353de31b-0600-44c7-a0ff-dad502455855 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fee95f-d92b-4e09-802a-cc0180051b1b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:02 devstack sudo[94786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:02 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:02 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.495s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:02 devstack sudo[94792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 1G
Sep 25 11:41:02 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:03 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 1G" returned: 0 in 0.658s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:03 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855
Sep 25 11:41:03 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:03 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:03 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 is being set with open permissions: ugo+rw
Sep 25 11:41:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:03 devstack sudo[94805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855
Sep 25 11:41:03 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:04 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855" returned: 0 in 0.341s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-abba0615-c17a-4bbc-bf05-bac33397e080 tempest-SnapshotsActionsTest-829575394 None] Create snapshot completed successfully
Sep 25 11:41:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8370d6e2-ac1d-40f7-a6d1-1c6f6d6efc21 tempest-GroupsTest-1322434149 None] Group tempest-Group1-851981458: creating
Sep 25 11:41:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8370d6e2-ac1d-40f7-a6d1-1c6f6d6efc21 tempest-GroupsTest-1322434149 None] Group tempest-Group1-851981458: created successfully
Sep 25 11:41:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8370d6e2-ac1d-40f7-a6d1-1c6f6d6efc21 tempest-GroupsTest-1322434149 None] Create group completed successfully.
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-353de31b-0600-44c7-a0ff-dad502455855-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-353de31b-0600-44c7-a0ff-dad502455855-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-353de31b-0600-44c7-a0ff-dad502455855" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-353de31b-0600-44c7-a0ff-dad502455855" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Deleting offline snapshot 353de31b-0600-44c7-a0ff-dad502455855 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] snapshot_file for this snap is: volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[48efc552-2ad8-4427-aff5-2b76120b7d03]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-036d3341-2fb5-49ca-a399-5bca771a0231 tempest-GroupsTest-1322434149 None] Group tempest-Group2-372787801: creating
Sep 25 11:41:05 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855
Sep 25 11:41:05 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-036d3341-2fb5-49ca-a399-5bca771a0231 tempest-GroupsTest-1322434149 None] Group tempest-Group2-372787801: created successfully
Sep 25 11:41:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-036d3341-2fb5-49ca-a399-5bca771a0231 tempest-GroupsTest-1322434149 None] Create group completed successfully.
Sep 25 11:41:06 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855" returned: 0 in 0.430s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5d141-0742-42cc-9f40-6836cc0c2cfc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:06 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:06 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:06 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.463s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:06 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855
Sep 25 11:41:06 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:07 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855" returned: 0 in 0.628s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:07 devstack sudo[94831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855
Sep 25 11:41:07 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:07 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.353de31b-0600-44c7-a0ff-dad502455855" returned: 0 in 0.496s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-353de31b-0600-44c7-a0ff-dad502455855" released by "_delete_snapshot" :: held 2.206s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_snapshot" :: held 2.247s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Created reservations ['da1a2077-6e71-4d94-b42a-16127991a080', '40a6a986-79b6-49d3-843f-215291e3a86e', 'fda09b02-f394-4844-a738-4faa1dd8cf6e', 'a27b9177-20bb-4c06-9121-d25ee8fb23ef'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (8c35c140-be0e-42ba-a6ad-8f293b470af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba0299-dfbc-4f76-a905-c6f7f5d2e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba0299-dfbc-4f76-a905-c6f7f5d2e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295660785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d21b348d-cc18-4f8f-b4f8-9aff7ee1636c,host='devstack@QuobyteHD#QuobyteHD',id=8b6365f0-8078-4995-89dc-30094c0cc062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5740e8-9fdb-4f92-91e4-5dfeb051c9d0),volume_type_id=0b5740e8-9fdb-4f92-91e4-5dfeb051c9d0)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f28bcb-bc00-4002-81f1-f5e7338ebd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f28bcb-bc00-4002-81f1-f5e7338ebd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be306bb-7d96-474a-b6b5-269a1af80d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be306bb-7d96-474a-b6b5-269a1af80d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6365f0-8078-4995-89dc-30094c0cc062', 'volume_name': 'volume-8b6365f0-8078-4995-89dc-30094c0cc062', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9028c9-a177-4a39-bd9f-0528a2baa29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9028c9-a177-4a39-bd9f-0528a2baa29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e080de64-31c6-4582-a7bc-f0eb6687730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:08 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Volume 8b6365f0-8078-4995-89dc-30094c0cc062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6365f0-8078-4995-89dc-30094c0cc062', 'volume_size': 1}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d21b348d-cc18-4f8f-b4f8-9aff7ee1636c,created_at=2026-09-25T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295660785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d21b348d-cc18-4f8f-b4f8-9aff7ee1636c,host='devstack@QuobyteHD#QuobyteHD',id=8b6365f0-8078-4995-89dc-30094c0cc062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5740e8-9fdb-4f92-91e4-5dfeb051c9d0),volume_type_id=0b5740e8-9fdb-4f92-91e4-5dfeb051c9d0)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Creating volume 8b6365f0-8078-4995-89dc-30094c0cc062 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:08 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:08 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 1073741824
Sep 25 11:41:08 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Delete snapshot completed successfully.
Sep 25 11:41:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1084af3-c636-4e7a-a33a-5e5b310af38f tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-353de31b-0600-44c7-a0ff-dad502455855-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:09 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 1073741824" returned: 0 in 0.908s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:09 devstack sudo[94840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062
Sep 25 11:41:09 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:09 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Creating offline snapshot 1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e080de64-31c6-4582-a7bc-f0eb6687730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6365f0-8078-4995-89dc-30094c0cc062', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e178808-018b-4787-a797-39fb0fd872de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce754918-2002-4433-bceb-5c06a321ed86]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:09 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Volume volume-8b6365f0-8078-4995-89dc-30094c0cc062 (8b6365f0-8078-4995-89dc-30094c0cc062): created successfully
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e178808-018b-4787-a797-39fb0fd872de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (8c35c140-be0e-42ba-a6ad-8f293b470af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fa7cbf85-c702-4447-9a7d-afa5735182e6 tempest-GroupsTest-1322434149 None] Created volume successfully.
Sep 25 11:41:09 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:09 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:10 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.481s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:10 devstack sudo[94848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 1G
Sep 25 11:41:10 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:10 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 1G" returned: 0 in 0.613s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:10 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5
Sep 25 11:41:10 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:11 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" returned: 0 in 0.416s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:11 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 is being set with open permissions: ugo+rw
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:11 devstack sudo[94859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5
Sep 25 11:41:11 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Acquiring lock "cinder-quobyte-8b6365f0-8078-4995-89dc-30094c0cc062" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-8b6365f0-8078-4995-89dc-30094c0cc062" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:11 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c914d8-3dce-47c9-9a55-fede5b3b76b4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d9203a32-3cd0-4706-9a75-e17576be3aee tempest-SnapshotsActionsTest-829575394 None] Create snapshot completed successfully
Sep 25 11:41:11 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062
Sep 25 11:41:11 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:12 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:12 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062
Sep 25 11:41:12 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:12 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b6365f0-8078-4995-89dc-30094c0cc062" returned: 0 in 0.303s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-8b6365f0-8078-4995-89dc-30094c0cc062" released by "delete_volume" :: held 0.816s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Created reservations ['21a649f5-7f75-4ce5-8616-e5eda16a5f14'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:12 devstack cinder-volume[87358]: WARNING cinder.quota [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-837328119 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-837328119, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:41:12 devstack cinder-volume[87358]: WARNING cinder.quota [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-837328119 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-837328119, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Created reservations ['a327f80e-1586-4fcf-94d7-48fe7248c078', 'bcf249e3-4861-4c17-a79e-ffaeb55185f5', '84674b5a-014f-4714-8c31-5c76753ea72b', '6a8551a8-0de5-433b-b011-27b4724612ad'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:12 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:12 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:13 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-01d1a1cc-5c96-4279-a021-0cc21899d31f tempest-GroupsTest-1322434149 None] Delete group completed successfully.
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Acquiring lock "cinder-quobyte-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Deleting offline snapshot 1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] snapshot_file for this snap is: volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df2603-c7ce-49a3-b1c2-7dd11fd87983]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Created reservations ['a85bd5db-58a8-44f2-ae1e-8f4d106b112e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:13 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5
Sep 25 11:41:13 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:13 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:13 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:13 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8c7646a4-58e3-4f79-97f1-5d755c4128ef tempest-GroupsTest-1322434149 None] Delete group completed successfully.
Sep 25 11:41:13 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" returned: 0 in 0.479s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c392e-b9e4-4ae6-8b34-695ca8c6de99]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:13 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:13 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:14 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.533s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:14 devstack sudo[94886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5
Sep 25 11:41:14 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-83ab2beb-57c3-408b-80e4-516c25ecb391 tempest-GroupsTest-1322434149 None] Group tempest-GroupsTest-Group-1803893560: creating
Sep 25 11:41:14 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" returned: 0 in 0.604s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-83ab2beb-57c3-408b-80e4-516c25ecb391 tempest-GroupsTest-1322434149 None] Group tempest-GroupsTest-Group-1803893560: created successfully
Sep 25 11:41:15 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5
Sep 25 11:41:15 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-83ab2beb-57c3-408b-80e4-516c25ecb391 tempest-GroupsTest-1322434149 None] Create group completed successfully.
Sep 25 11:41:15 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5" released by "_delete_snapshot" :: held 2.049s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_snapshot" :: held 2.082s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Created reservations ['5286b58f-fa83-4360-ba44-5e65eea1fd2e', 'f6d8c400-d24f-4c97-b647-2dd72ff05326', 'dbd1f97c-b099-443a-b079-8a8ef02c50b9', 'c9aa86fe-6436-4036-abcc-0689e8d76d48'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Delete snapshot completed successfully.
Sep 25 11:41:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c5b10e6d-afb5-4c80-8498-c2647a91407e tempest-SnapshotsActionsTest-1795553146 None] Lock "cinder-1004bc93-d2a3-48d9-8cb9-5cde1dd39ca5-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:16 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (218235a9-193e-4161-8670-93e375dd6be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78c03f2-0720-42e7-bdbc-f6615bb5c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "cinder-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78c03f2-0720-42e7-bdbc-f6615bb5c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047884018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8671e508-2556-4183-8804-4b59a7007739,host='devstack@QuobyteHD#QuobyteHD',id=52e6b931-8f62-4379-82bb-fefdb2e0b5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:17Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa858243-96c2-4e4a-a4fe-fafb2a04a8a8),volume_type_id=aa858243-96c2-4e4a-a4fe-fafb2a04a8a8)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50307f1-72c3-43d0-a513-ba320d058419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50307f1-72c3-43d0-a513-ba320d058419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351180d6-ce1f-4778-92a7-f14afcaae3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351180d6-ce1f-4778-92a7-f14afcaae3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e6b931-8f62-4379-82bb-fefdb2e0b5a1', 'volume_name': 'volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e87a937-257d-4db5-a8ea-36b684a24c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e87a937-257d-4db5-a8ea-36b684a24c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f61c03b-8032-4378-99b7-f1e0cc50e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:17 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Volume 52e6b931-8f62-4379-82bb-fefdb2e0b5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1', 'volume_size': 1}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8671e508-2556-4183-8804-4b59a7007739,created_at=2026-09-25T09:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047884018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8671e508-2556-4183-8804-4b59a7007739,host='devstack@QuobyteHD#QuobyteHD',id=52e6b931-8f62-4379-82bb-fefdb2e0b5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:17Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa858243-96c2-4e4a-a4fe-fafb2a04a8a8),volume_type_id=aa858243-96c2-4e4a-a4fe-fafb2a04a8a8)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Creating volume 52e6b931-8f62-4379-82bb-fefdb2e0b5a1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:17 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:17 devstack sudo[94896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 1073741824
Sep 25 11:41:17 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "cinder-quobyte-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Deleting offline snapshot bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 of volume ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] snapshot_file for this snap is: volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[874dfe04-972c-42fb-8b3c-a0d2a6864059]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:17 devstack sudo[94898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:17 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:17 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 1073741824" returned: 0 in 0.698s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:17 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.581s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d4b91f-6825-429c-a16c-f71333f13258]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:17 devstack sudo[94908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1
Sep 25 11:41:17 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:18 devstack sudo[94907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b
Sep 25 11:41:18 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:18 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f61c03b-8032-4378-99b7-f1e0cc50e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5501afe3-1821-4eec-ae71-45755dcc218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Volume volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 (52e6b931-8f62-4379-82bb-fefdb2e0b5a1): created successfully
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5501afe3-1821-4eec-ae71-45755dcc218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (218235a9-193e-4161-8670-93e375dd6be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a7c484a0-a228-4133-9085-4dcf040bd2ac tempest-GroupsTest-1322434149 None] Created volume successfully.
Sep 25 11:41:18 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" returned: 0 in 0.604s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:18 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:18 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:18 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.485s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:18 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62
Sep 25 11:41:18 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:19 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b.bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" returned: 0 in 0.302s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62" released by "_delete_snapshot" :: held 2.152s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_snapshot" :: held 2.188s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:19 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Created reservations ['e5ec7276-10b3-42e4-9d93-c336b5af4a63', '72fd025d-d061-4c76-ae86-e10ecbcb8a3b', 'd98659e4-7602-4eb5-a729-3985a8b35e29', '9a6f9328-3cd7-4d85-b3e8-ab39334b5423'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Delete snapshot completed successfully.
Sep 25 11:41:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5b9b9dde-7eff-4f57-a270-f20fc373fe31 tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-bb0e2fb7-dd56-44d0-81d4-11b95d09ae62-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "cinder-ecb8542b-883a-4bb0-ae58-f0b353f8d27b-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-ecb8542b-883a-4bb0-ae58-f0b353f8d27b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (d1d6c704-9567-444d-acd4-8cd9fd4ec3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3642174-b587-4d25-a857-eaa83be51225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3642174-b587-4d25-a857-eaa83be51225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671279000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8671e508-2556-4183-8804-4b59a7007739,host='devstack@QuobyteHD#QuobyteHD',id=27968a5e-5fe1-45c3-ac25-aefd9119187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:20Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa858243-96c2-4e4a-a4fe-fafb2a04a8a8),volume_type_id=aa858243-96c2-4e4a-a4fe-fafb2a04a8a8)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869dd05-df2c-4657-991f-e16d3166206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869dd05-df2c-4657-991f-e16d3166206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2410e41-c06c-473b-a440-ecf1de831ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2410e41-c06c-473b-a440-ecf1de831ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27968a5e-5fe1-45c3-ac25-aefd9119187c', 'volume_name': 'volume-27968a5e-5fe1-45c3-ac25-aefd9119187c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd803144-5b84-4f63-96af-13e6ef666361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd803144-5b84-4f63-96af-13e6ef666361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321159cd-f69f-48ae-921f-1547d375de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Volume 27968a5e-5fe1-45c3-ac25-aefd9119187c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27968a5e-5fe1-45c3-ac25-aefd9119187c', 'volume_size': 1}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8671e508-2556-4183-8804-4b59a7007739,created_at=2026-09-25T09:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671279000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8671e508-2556-4183-8804-4b59a7007739,host='devstack@QuobyteHD#QuobyteHD',id=27968a5e-5fe1-45c3-ac25-aefd9119187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba85b6692941d6abc4e6a2b42a91e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:20Z,use_quota=True,user_id='b1419bdd3f594c9694ea072498c0f081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa858243-96c2-4e4a-a4fe-fafb2a04a8a8),volume_type_id=aa858243-96c2-4e4a-a4fe-fafb2a04a8a8)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Creating volume 27968a5e-5fe1-45c3-ac25-aefd9119187c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:20 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:20 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c 1073741824
Sep 25 11:41:20 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a604fa-2cac-4532-816f-434c3454d772]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:20 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b
Sep 25 11:41:20 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:21 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:21 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b
Sep 25 11:41:21 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:21 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c 1073741824" returned: 0 in 0.632s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:21 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c
Sep 25 11:41:21 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:21 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" returned: 0 in 0.424s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:21 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-quobyte-ecb8542b-883a-4bb0-ae58-f0b353f8d27b" released by "delete_volume" :: held 0.994s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321159cd-f69f-48ae-921f-1547d375de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27968a5e-5fe1-45c3-ac25-aefd9119187c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0b799-61ab-4fbb-9ff8-0713cf7a0b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Volume volume-27968a5e-5fe1-45c3-ac25-aefd9119187c (27968a5e-5fe1-45c3-ac25-aefd9119187c): created successfully
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0b799-61ab-4fbb-9ff8-0713cf7a0b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Flow 'volume_create_manager' (d1d6c704-9567-444d-acd4-8cd9fd4ec3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-addff4a0-2491-4e2d-a981-ac8979e2cafb tempest-GroupsTest-1322434149 None] Created volume successfully.
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Created reservations ['3f8ff005-491e-4217-bbd3-5968b061a542', '877a4cbb-e944-48ec-93ef-7f1c76e09c7e', 'efd40c7e-fec2-4fbd-9ba8-37e864ca5e6b', 'ca21b6c7-cb7a-4e7d-a86d-8f17e7a56230'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:21 devstack sudo[94941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:21 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:22 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:22 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Deleted volume successfully.
Sep 25 11:41:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-559b5635-cf57-4a7b-b51d-3712f72d2ead tempest-SnapshotsActionsTest-829575394 None] Lock "cinder-ecb8542b-883a-4bb0-ae58-f0b353f8d27b-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e02613f4-1d3c-48cc-b06d-629c282e2f08 tempest-GroupsTest-1322434149 None] Update group completed successfully.
Sep 25 11:41:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-847916bf-9bd2-49e8-a2d6-681d1142baa0 req-6c3c11d4-65fb-456a-bf56-adcc0fa3c22d tempest-ServerActionsTestOtherA-197499957 None] Terminate volume connection completed successfully.
Sep 25 11:41:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-847916bf-9bd2-49e8-a2d6-681d1142baa0 req-6c3c11d4-65fb-456a-bf56-adcc0fa3c22d tempest-ServerActionsTestOtherA-197499957 None] Deleting attachment e3acdcd6-86bc-4760-990e-fb6799176e97. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:41:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1f2af641-de86-4203-bb42-afd95b7ad532 tempest-GroupsTest-1322434149 None] Update group completed successfully.
Sep 25 11:41:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Acquiring lock "cinder-quobyte-27968a5e-5fe1-45c3-ac25-aefd9119187c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-27968a5e-5fe1-45c3-ac25-aefd9119187c" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:26 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ecf68-03b8-4d7b-86a8-6fbcca1c0873]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:27 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c
Sep 25 11:41:27 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:27 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c" returned: 0 in 0.616s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:27 devstack sudo[94991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c
Sep 25 11:41:27 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:27 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-27968a5e-5fe1-45c3-ac25-aefd9119187c" returned: 0 in 0.408s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-27968a5e-5fe1-45c3-ac25-aefd9119187c" released by "delete_volume" :: held 1.095s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Acquiring lock "cinder-quobyte-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66152e8-0153-4a9f-844a-62990e15cf56]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:28 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1
Sep 25 11:41:28 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:28 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" returned: 0 in 0.728s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:28 devstack sudo[95002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1
Sep 25 11:41:28 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:29 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" returned: 0 in 0.447s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "cinder-quobyte-52e6b931-8f62-4379-82bb-fefdb2e0b5a1" released by "delete_volume" :: held 1.241s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Created reservations ['52d48c3c-c061-46df-bc25-b80e36d7245f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:29 devstack cinder-volume[87358]: WARNING cinder.quota [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1851078445 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1851078445, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:41:29 devstack cinder-volume[87358]: WARNING cinder.quota [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1851078445 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1851078445, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Created reservations ['4c08c932-9dd8-42b1-ac9e-41d56805297f', '87db30cc-8698-413a-b00e-89c243ca55db', '92ae1c81-a762-4a37-a6ef-b0da172d70e4', '84ed72fc-2a5a-4ca6-9fa4-fdd323fb45b2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Created reservations ['de0d6631-8959-48ef-9f46-a830f156abfd', 'e2e2cfaf-e1d4-4c28-8443-ccdd2b447a70', '4cd15e75-5da7-425b-bfa3-9a89a114904b', '8fe48ac7-aca9-4771-bac7-465bd0adb681'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:29 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:29 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:30 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.328s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:30 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-04d966af-08c4-41a7-b8e2-d4871d4424cf tempest-GroupsTest-1322434149 None] Delete group completed successfully.
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Flow 'volume_create_manager' (2f0f745a-1bf3-44c0-b3b1-027b2963cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6b56a7-bc7b-4a61-9eb1-f98aa682e797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6b56a7-bc7b-4a61-9eb1-f98aa682e797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-449092912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177a274-4923-4f6c-88e5-352dd0b2a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4787e7f82944ab986211d1ebcc218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:35Z,use_quota=True,user_id='d1aa9342035b4a71adf1c8b881b39d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce54969-76a1-49b2-88ca-e0ed9ec52e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce54969-76a1-49b2-88ca-e0ed9ec52e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97571120-735b-44d3-aa54-1ccdc2885f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:34 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:41:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97571120-735b-44d3-aa54-1ccdc2885f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9177a274-4923-4f6c-88e5-352dd0b2a4af', 'volume_name': 'volume-9177a274-4923-4f6c-88e5-352dd0b2a4af', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645cc50>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4aa8fb-8c7d-4a1e-80a2-1f2466b3d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4aa8fb-8c7d-4a1e-80a2-1f2466b3d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fbc816-c2a1-47e0-ba8b-4cef55e58594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Volume 9177a274-4923-4f6c-88e5-352dd0b2a4af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9177a274-4923-4f6c-88e5-352dd0b2a4af', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645cc50>}
Sep 25 11:41:35 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Trying to clone 9177a274-4923-4f6c-88e5-352dd0b2a4af from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:41:36 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:41:36 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 11:41:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e4ad69-a92f-4f43-9e85-43cbd2ba8d89]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:36 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD
Sep 25 11:41:36 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD" returned: 0 in 0.592s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:36 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 is fetched for user d1aa9342035b4a71adf1c8b881b39d67. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:41:36 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[412045bf-03d2-455c-9de0-303e023178a1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:37 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD
Sep 25 11:41:37 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:38 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD" returned: 0 in 0.904s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-449092912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177a274-4923-4f6c-88e5-352dd0b2a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4787e7f82944ab986211d1ebcc218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:35Z,use_quota=True,user_id='d1aa9342035b4a71adf1c8b881b39d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Creating volume 9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:38 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:38 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1073741824
Sep 25 11:41:38 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:39 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1073741824" returned: 0 in 0.858s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:39 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af
Sep 25 11:41:39 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:39 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af" returned: 0 in 0.400s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Attempting download of 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 9177a274-4923-4f6c-88e5-352dd0b2a4af. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[84049453-d371-4e1c-a764-96666a5291fa]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:39 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv
Sep 25 11:41:39 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:40 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:40 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv
Sep 25 11:41:40 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:41 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv" returned: 1 in 1.008s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_oxeohawv' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2490f-373d-413f-b2dc-e44353d16353]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:41 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD
Sep 25 11:41:41 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:41 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD" returned: 0 in 0.786s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] 5646eeca-3c92-4e68-971d-05dbb021a3a9 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:41:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:42 devstack sudo[95164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af
Sep 25 11:41:42 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:46 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af" returned: 0 in 4.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:46 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_871hr2o0devstack@QuobyteHD, size 112.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:41:46 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Converted 112.00 MB image at 25.56 MB/s
Sep 25 11:41:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:46 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1G
Sep 25 11:41:46 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:47 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af 1G" returned: 0 in 0.772s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Downloaded image 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 9177a274-4923-4f6c-88e5-352dd0b2a4af successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 for user d1aa9342035b4a71adf1c8b881b39d67 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Marking volume 9177a274-4923-4f6c-88e5-352dd0b2a4af as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Copying metadata from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 to 9177a274-4923-4f6c-88e5-352dd0b2a4af. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Creating volume glance metadata for volume 9177a274-4923-4f6c-88e5-352dd0b2a4af backed by image 5646eeca-3c92-4e68-971d-05dbb021a3a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fbc816-c2a1-47e0-ba8b-4cef55e58594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9177a274-4923-4f6c-88e5-352dd0b2a4af', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645cc50>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54484fe6-6478-4724-bd87-757001684d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Volume volume-9177a274-4923-4f6c-88e5-352dd0b2a4af (9177a274-4923-4f6c-88e5-352dd0b2a4af): created successfully
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54484fe6-6478-4724-bd87-757001684d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Flow 'volume_create_manager' (2f0f745a-1bf3-44c0-b3b1-027b2963cca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b1725d22-8eb2-4462-a1ce-3fbe637bda90 tempest-ServerActionsTestOtherA-197499957 None] Created volume successfully.
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:51 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:51 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:51 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.487s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:41:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:41:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=90,cinder:INSERT=20,cinder:UPDATE=87,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=87,cinder:UPDATE=92,cinder:DELETE=5,cinder:INSERT=36 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Flow 'volume_create_manager' (6962c3db-6b74-4477-a4b0-94afc59f4296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e9597c-5e64-41f1-853f-5af77fc0c550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e9597c-5e64-41f1-853f-5af77fc0c550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-783875950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a44acb-1cec-430b-9f2b-450d2acca3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9287d07aa544ae90b51be9008e0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:53Z,use_quota=True,user_id='7240610a1cff424eb62290070903a741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e082b863-85dd-46a0-86f1-f81d88ffc498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e082b863-85dd-46a0-86f1-f81d88ffc498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf73ac0-5d93-4324-81bb-8aa510008073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf73ac0-5d93-4324-81bb-8aa510008073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a44acb-1cec-430b-9f2b-450d2acca3d1', 'volume_name': 'volume-78a44acb-1cec-430b-9f2b-450d2acca3d1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f01981-6650-479f-b105-b73c5b0d4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f01981-6650-479f-b105-b73c5b0d4b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6555f-db30-4934-8471-2bb3d7fe682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume 78a44acb-1cec-430b-9f2b-450d2acca3d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a44acb-1cec-430b-9f2b-450d2acca3d1', 'volume_size': 1}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-783875950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a44acb-1cec-430b-9f2b-450d2acca3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9287d07aa544ae90b51be9008e0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:53Z,use_quota=True,user_id='7240610a1cff424eb62290070903a741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Creating volume 78a44acb-1cec-430b-9f2b-450d2acca3d1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:53 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4663966d-8f15-4ea2-87dd-0928f9d83b2f req-2488be93-de4b-4edc-a394-e04a1eb565a1 tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:53 devstack sudo[95233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 1073741824
Sep 25 11:41:53 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:54 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 1073741824" returned: 0 in 0.807s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:54 devstack sudo[95262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1
Sep 25 11:41:54 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:54 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1" returned: 0 in 0.459s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4663966d-8f15-4ea2-87dd-0928f9d83b2f req-2488be93-de4b-4edc-a394-e04a1eb565a1 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.321s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4663966d-8f15-4ea2-87dd-0928f9d83b2f req-2488be93-de4b-4edc-a394-e04a1eb565a1 tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6555f-db30-4934-8471-2bb3d7fe682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a44acb-1cec-430b-9f2b-450d2acca3d1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdb9483-a5be-40ed-99ed-b417873d7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 (78a44acb-1cec-430b-9f2b-450d2acca3d1): created successfully
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdb9483-a5be-40ed-99ed-b417873d7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Flow 'volume_create_manager' (6962c3db-6b74-4477-a4b0-94afc59f4296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a54d31e4-b7d6-4187-b79b-46d0f9cc9fc9 tempest-VolumeQuotasAdminTestJSON-49338282 None] Created volume successfully.
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4663966d-8f15-4ea2-87dd-0928f9d83b2f req-2488be93-de4b-4edc-a394-e04a1eb565a1 tempest-ServerActionsTestOtherA-197499957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-9177a274-4923-4f6c-88e5-352dd0b2a4af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68a76dc1-2647-43ce-96b5-a5a6399d04db', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:41:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4663966d-8f15-4ea2-87dd-0928f9d83b2f req-2488be93-de4b-4edc-a394-e04a1eb565a1 tempest-ServerActionsTestOtherA-197499957 None] attachment_update completed successfully.
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "cinder-78a44acb-1cec-430b-9f2b-450d2acca3d1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "cinder-78a44acb-1cec-430b-9f2b-450d2acca3d1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "cinder-quobyte-78a44acb-1cec-430b-9f2b-450d2acca3d1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "cinder-quobyte-78a44acb-1cec-430b-9f2b-450d2acca3d1" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[61932127-2d84-437a-aaa4-6c2f3e1c83dc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:41:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:55 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1
Sep 25 11:41:55 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:56 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1" returned: 0 in 0.480s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:56 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1
Sep 25 11:41:56 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:56 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-78a44acb-1cec-430b-9f2b-450d2acca3d1" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "cinder-quobyte-78a44acb-1cec-430b-9f2b-450d2acca3d1" released by "delete_volume" :: held 0.866s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Created reservations ['eabc56d4-583c-48d4-b1fb-00d79298fd42', '21c8ec3f-04fb-40a3-a75b-7efac1c0ca0e', 'b65b278c-aec2-4f6c-933d-8e16cc296d8c', '13100f3b-1184-4605-954f-24028c1dad8f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:56 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:41:56 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:57 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.580s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:41:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Deleted volume successfully.
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eab8b62f-7cca-442d-9646-800bedc10456 tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "cinder-78a44acb-1cec-430b-9f2b-450d2acca3d1-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Flow 'volume_create_manager' (3030ce60-4b82-4475-9ee0-23aaf639a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5094d9-e988-49da-8fb2-38db85b7d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5094d9-e988-49da-8fb2-38db85b7d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1760411058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf63a034-7f82-4dbd-92bd-2e97c8213af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9287d07aa544ae90b51be9008e0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:58Z,use_quota=True,user_id='7240610a1cff424eb62290070903a741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6dc4fc-e88a-4ecf-97a4-ddacf71aae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6dc4fc-e88a-4ecf-97a4-ddacf71aae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ab38aa-d3bf-4356-8fba-e17471406720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ab38aa-d3bf-4356-8fba-e17471406720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf63a034-7f82-4dbd-92bd-2e97c8213af3', 'volume_name': 'volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbc5407-08ed-4720-abd6-e50cb4751f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbc5407-08ed-4720-abd6-e50cb4751f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c9b027-598d-45ec-82c2-6a64ce230924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume bf63a034-7f82-4dbd-92bd-2e97c8213af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3', 'volume_size': 1}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1760411058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf63a034-7f82-4dbd-92bd-2e97c8213af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9287d07aa544ae90b51be9008e0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:58Z,use_quota=True,user_id='7240610a1cff424eb62290070903a741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Creating volume bf63a034-7f82-4dbd-92bd-2e97c8213af3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:41:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:58 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 1073741824
Sep 25 11:41:58 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:58 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 1073741824" returned: 0 in 0.542s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:41:58 devstack sudo[95759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3
Sep 25 11:41:58 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:41:58 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c9b027-598d-45ec-82c2-6a64ce230924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895350fa-946e-46aa-b0ca-10d6daae4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:41:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Volume volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 (bf63a034-7f82-4dbd-92bd-2e97c8213af3): created successfully
Sep 25 11:41:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895350fa-946e-46aa-b0ca-10d6daae4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:41:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Flow 'volume_create_manager' (3030ce60-4b82-4475-9ee0-23aaf639a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:41:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ce7d9b80-25a4-426a-af10-e945fa2177ea tempest-VolumeQuotasAdminTestJSON-49338282 None] Created volume successfully.
Sep 25 11:42:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e3c71843-415c-497c-8bac-e8cd54bf60b5 tempest-VolumeQuotasAdminTestJSON-469828251 None] Transfer volume completed successfully.
Sep 25 11:42:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Acquiring lock "cinder-bf63a034-7f82-4dbd-92bd-2e97c8213af3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "cinder-bf63a034-7f82-4dbd-92bd-2e97c8213af3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Acquiring lock "cinder-quobyte-bf63a034-7f82-4dbd-92bd-2e97c8213af3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "cinder-quobyte-bf63a034-7f82-4dbd-92bd-2e97c8213af3" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427a6e5-875e-4400-9639-b8b1d441b5d9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:02 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3
Sep 25 11:42:02 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:03 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3" returned: 0 in 0.902s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:03 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3
Sep 25 11:42:03 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:03 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bf63a034-7f82-4dbd-92bd-2e97c8213af3" returned: 0 in 0.678s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "cinder-quobyte-bf63a034-7f82-4dbd-92bd-2e97c8213af3" released by "delete_volume" :: held 1.706s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:03 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Created reservations ['3ee6e2cf-8a36-4171-87d4-957ef8994d5a', 'f2ddaca7-36a3-4434-a269-eadb01499d5e', 'ea4089ba-67fa-43b1-a89b-705e1f9a1b1a', '7975ef26-5980-4dd7-9698-89732e707619'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:04 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:04 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:04 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.705s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Deleted volume successfully.
Sep 25 11:42:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbfc154f-82bf-4cd2-8110-4ab88175483c tempest-VolumeQuotasAdminTestJSON-430202670 None] Lock "cinder-bf63a034-7f82-4dbd-92bd-2e97c8213af3-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Flow 'volume_create_manager' (74f9ccb7-f167-4e3d-9c98-b562eff9b45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a15d20-09fd-4c79-87af-163992650a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a15d20-09fd-4c79-87af-163992650a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607826574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af85b0ef-5167-417b-8294-0b793075c262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c95f469afb549d0907b333a9974425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:08Z,use_quota=True,user_id='69805ffef0304e41a59af0b57008aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad18bf88-232d-478e-81f7-9a15802e225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad18bf88-232d-478e-81f7-9a15802e225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc2bec-5d18-441f-9201-6d6995a4e37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc2bec-5d18-441f-9201-6d6995a4e37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af85b0ef-5167-417b-8294-0b793075c262', 'volume_name': 'volume-af85b0ef-5167-417b-8294-0b793075c262', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c7e1e4-32ef-4caa-a334-d4475b103af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c7e1e4-32ef-4caa-a334-d4475b103af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee2dccd-7e31-4a40-8a37-d8761593712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:08 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Volume af85b0ef-5167-417b-8294-0b793075c262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af85b0ef-5167-417b-8294-0b793075c262', 'volume_size': 1}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607826574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af85b0ef-5167-417b-8294-0b793075c262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c95f469afb549d0907b333a9974425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:08Z,use_quota=True,user_id='69805ffef0304e41a59af0b57008aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Creating volume af85b0ef-5167-417b-8294-0b793075c262 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:42:08 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:42:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:08 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 1073741824
Sep 25 11:42:08 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:09 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 1073741824" returned: 0 in 1.105s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:09 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262
Sep 25 11:42:09 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:10 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262" returned: 0 in 0.468s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee2dccd-7e31-4a40-8a37-d8761593712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af85b0ef-5167-417b-8294-0b793075c262', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b352a9-f4fa-441c-a212-90af2cf950b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:10 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Volume volume-af85b0ef-5167-417b-8294-0b793075c262 (af85b0ef-5167-417b-8294-0b793075c262): created successfully
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b352a9-f4fa-441c-a212-90af2cf950b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Flow 'volume_create_manager' (74f9ccb7-f167-4e3d-9c98-b562eff9b45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9b650b2e-07fa-476d-bd74-996e06591848 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Created volume successfully.
Sep 25 11:42:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-0b47fa56-1d79-497b-bb06-4d5abacb7cb2 tempest-ServerActionsTestOtherA-197499957 None] Terminate volume connection completed successfully.
Sep 25 11:42:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-0b47fa56-1d79-497b-bb06-4d5abacb7cb2 tempest-ServerActionsTestOtherA-197499957 None] Deleting attachment 68a76dc1-2647-43ce-96b5-a5a6399d04db. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:42:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-fb45a2e7-8afd-4928-8100-f7540db605d4 req-ef1de229-457d-41c0-b6f8-7db99651c15d tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-fb45a2e7-8afd-4928-8100-f7540db605d4 req-ef1de229-457d-41c0-b6f8-7db99651c15d tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-fb45a2e7-8afd-4928-8100-f7540db605d4 req-ef1de229-457d-41c0-b6f8-7db99651c15d tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-fb45a2e7-8afd-4928-8100-f7540db605d4 req-ef1de229-457d-41c0-b6f8-7db99651c15d tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-af85b0ef-5167-417b-8294-0b793075c262', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00d79638-d3fa-4b23-9b89-509eac53fd0f', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:42:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-fb45a2e7-8afd-4928-8100-f7540db605d4 req-ef1de229-457d-41c0-b6f8-7db99651c15d tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] attachment_update completed successfully.
Sep 25 11:42:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-7ecda72c-9286-4357-9ead-00c3beaa112e tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-7ecda72c-9286-4357-9ead-00c3beaa112e tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-7ecda72c-9286-4357-9ead-00c3beaa112e tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-7ecda72c-9286-4357-9ead-00c3beaa112e tempest-ServerActionsTestOtherA-197499957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-9177a274-4923-4f6c-88e5-352dd0b2a4af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6db12dfc-684a-4577-a557-d95a66ef0255', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:42:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4ad18766-ed0c-456e-9473-c4bb43754cad req-7ecda72c-9286-4357-9ead-00c3beaa112e tempest-ServerActionsTestOtherA-197499957 None] attachment_update completed successfully.
Sep 25 11:42:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-12f689ab-8d27-44fe-9931-39fdfab6b411 req-a3990fe8-b8c6-433c-a637-da8e02d102ce tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Terminate volume connection completed successfully.
Sep 25 11:42:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-12f689ab-8d27-44fe-9931-39fdfab6b411 req-a3990fe8-b8c6-433c-a637-da8e02d102ce tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Deleting attachment 00d79638-d3fa-4b23-9b89-509eac53fd0f. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "cinder-af85b0ef-5167-417b-8294-0b793075c262-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "cinder-af85b0ef-5167-417b-8294-0b793075c262-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "cinder-quobyte-af85b0ef-5167-417b-8294-0b793075c262" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "cinder-quobyte-af85b0ef-5167-417b-8294-0b793075c262" acquired by "delete_volume" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[98619793-09d6-4194-aeb4-d3afb0ff2db1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:20 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262
Sep 25 11:42:20 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:42:20 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Flow 'volume_create_manager' (9d19e11e-5254-4413-b360-829c66587a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075d57a4-cf22-4368-b818-d7dc04a99118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262" returned: 0 in 1.071s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075d57a4-cf22-4368-b818-d7dc04a99118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613823756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417225e5-5822-4217-89b9-91c6979148e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b8c189261a44f8a192cd4559cae59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:21Z,use_quota=True,user_id='9bd582b561f94c649110f60218ea96ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:20 devstack sudo[96387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262
Sep 25 11:42:20 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b3d259-5d90-45a4-b281-2a49472cfb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b3d259-5d90-45a4-b281-2a49472cfb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee92f3de-1953-447d-9795-b824dc3d4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee92f3de-1953-447d-9795-b824dc3d4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '417225e5-5822-4217-89b9-91c6979148e4', 'volume_name': 'volume-417225e5-5822-4217-89b9-91c6979148e4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44920bf8-30e7-4979-8b6e-914a1d41c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44920bf8-30e7-4979-8b6e-914a1d41c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7d085b-a689-406f-b082-fb46fbbfb137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Volume 417225e5-5822-4217-89b9-91c6979148e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-417225e5-5822-4217-89b9-91c6979148e4', 'volume_size': 1}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613823756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417225e5-5822-4217-89b9-91c6979148e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b8c189261a44f8a192cd4559cae59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:21Z,use_quota=True,user_id='9bd582b561f94c649110f60218ea96ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Creating volume 417225e5-5822-4217-89b9-91c6979148e4 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:42:20 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:42:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:20 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 1073741824
Sep 25 11:42:20 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:21 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-af85b0ef-5167-417b-8294-0b793075c262" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "cinder-quobyte-af85b0ef-5167-417b-8294-0b793075c262" released by "delete_volume" :: held 1.631s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Created reservations ['7221284f-9cc1-4ffa-8f90-7609c493d194', 'b891f2ef-b034-4db0-a15c-3a68b74afa22', 'dbad7349-dafc-4f62-ab8c-ecd082374095', 'ea7b2982-2458-4d4c-881a-90ac1968a695'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:21 devstack sudo[96399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:21 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:21 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 1073741824" returned: 0 in 0.794s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:21 devstack sudo[96401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4
Sep 25 11:42:21 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:22 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.506s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Deleted volume successfully.
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-45f2ad29-e151-40ca-81e3-6442d1a93220 tempest-TestServerVolumeAttachScenarioOldVersion-1784585785 None] Lock "cinder-af85b0ef-5167-417b-8294-0b793075c262-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:22 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7d085b-a689-406f-b082-fb46fbbfb137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-417225e5-5822-4217-89b9-91c6979148e4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5ec5be-4b99-4688-8570-759a5dd7fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Volume volume-417225e5-5822-4217-89b9-91c6979148e4 (417225e5-5822-4217-89b9-91c6979148e4): created successfully
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5ec5be-4b99-4688-8570-759a5dd7fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Flow 'volume_create_manager' (9d19e11e-5254-4413-b360-829c66587a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-623ee81a-693f-4867-8d5a-9ace79e18489 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Created volume successfully.
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Flow 'volume_create_manager' (4d0befb5-0d1f-4635-a194-2e57e6f90d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994b500d-40d3-4ec8-adf8-9afb7eeb69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994b500d-40d3-4ec8-adf8-9afb7eeb69a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1516334105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2d0ba7-18f5-46d2-abcb-50d6142f89b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad335e27e5742828a78e16e0d979c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:23Z,use_quota=True,user_id='8b6478ea9a1b43b0bbe52334102c3c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0535614-d1d1-4515-9fd3-f4e9b48699b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0535614-d1d1-4515-9fd3-f4e9b48699b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db813b5-b873-4b30-b6d2-a36f41c0718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db813b5-b873-4b30-b6d2-a36f41c0718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2d0ba7-18f5-46d2-abcb-50d6142f89b6', 'volume_name': 'volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb48bf-91d8-4c01-9b35-a27d370f7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb48bf-91d8-4c01-9b35-a27d370f7032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7226c48a-d599-48fd-95ff-1e4e1fd2cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Volume 9e2d0ba7-18f5-46d2-abcb-50d6142f89b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6', 'volume_size': 1}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1516334105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2d0ba7-18f5-46d2-abcb-50d6142f89b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad335e27e5742828a78e16e0d979c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:23Z,use_quota=True,user_id='8b6478ea9a1b43b0bbe52334102c3c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Creating volume 9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:42:23 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:23 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 1073741824
Sep 25 11:42:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-e2ec09f1-d0a6-4e0b-a9af-a3f0e454f450 tempest-ServerActionsTestOtherA-197499957 None] Terminate volume connection completed successfully.
Sep 25 11:42:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-e2ec09f1-d0a6-4e0b-a9af-a3f0e454f450 tempest-ServerActionsTestOtherA-197499957 None] Deleting attachment 6db12dfc-684a-4577-a557-d95a66ef0255. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:42:23 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "cinder-9177a274-4923-4f6c-88e5-352dd0b2a4af-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-9177a274-4923-4f6c-88e5-352dd0b2a4af-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "cinder-quobyte-9177a274-4923-4f6c-88e5-352dd0b2a4af" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-quobyte-9177a274-4923-4f6c-88e5-352dd0b2a4af" acquired by "delete_volume" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe2dbdd-c127-49f3-8607-b690f76bca2e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:24 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af
Sep 25 11:42:24 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:24 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 1073741824" returned: 0 in 1.096s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:24 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6
Sep 25 11:42:24 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:25 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af" returned: 0 in 0.615s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:25 devstack sudo[96448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af
Sep 25 11:42:25 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:25 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Acquiring lock "cinder-417225e5-5822-4217-89b9-91c6979148e4-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7226c48a-d599-48fd-95ff-1e4e1fd2cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573f2ec-cb31-4209-a9e2-921001f0e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "cinder-58594d5b-7622-4e45-a375-48692f134a4b-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:25 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Volume volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 (9e2d0ba7-18f5-46d2-abcb-50d6142f89b6): created successfully
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573f2ec-cb31-4209-a9e2-921001f0e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Flow 'volume_create_manager' (4d0befb5-0d1f-4635-a194-2e57e6f90d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "cinder-417225e5-5822-4217-89b9-91c6979148e4-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-58594d5b-7622-4e45-a375-48692f134a4b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:25 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9177a274-4923-4f6c-88e5-352dd0b2a4af" returned: 0 in 0.473s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5845e7f1-3980-403b-88b0-1d8fbe6b8f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Created volume successfully.
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-quobyte-9177a274-4923-4f6c-88e5-352dd0b2a4af" released by "delete_volume" :: held 1.177s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Acquiring lock "cinder-quobyte-417225e5-5822-4217-89b9-91c6979148e4" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "cinder-quobyte-58594d5b-7622-4e45-a375-48692f134a4b" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "cinder-quobyte-417225e5-5822-4217-89b9-91c6979148e4" acquired by "delete_volume" :: waited 0.057s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-quobyte-58594d5b-7622-4e45-a375-48692f134a4b" acquired by "delete_volume" :: waited 0.070s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc0e09-7ad9-492e-bb97-5ce48b3c564e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc004c5-ad37-42a5-8f98-7e8298d1b6ce]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Creating offline snapshot 7adddbbf-b898-450c-b01a-79b23c2000e2 of volume 9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fca6bd-194d-471a-afb3-3ef387e5eb38]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.quota [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Created reservations ['7f9f5756-c1d7-42b9-8fc5-fea4ea355ee9', 'c77bbc3d-9f46-45b2-972b-141bda59abba', '7c08c08f-215a-409a-8dee-a3655242ca80', '52bf7a59-33c7-475e-a45f-041938cf788c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:26 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b
Sep 25 11:42:26 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4
Sep 25 11:42:26 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:26 devstack sudo[96457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6
Sep 25 11:42:26 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:26 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4" returned: 0 in 0.731s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:26 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b" returned: 0 in 0.736s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:26 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4
Sep 25 11:42:26 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b
Sep 25 11:42:26 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" returned: 0 in 0.696s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:26 devstack sudo[96479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 1G
Sep 25 11:42:26 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:26 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.567s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.manager [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Deleted volume successfully.
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-50714b9f-0192-4c1e-a2d1-2a90fa930dae req-3439d741-6442-45ba-8610-62f9c147d25d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-9177a274-4923-4f6c-88e5-352dd0b2a4af-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:26 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-417225e5-5822-4217-89b9-91c6979148e4" returned: 0 in 0.352s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "cinder-quobyte-417225e5-5822-4217-89b9-91c6979148e4" released by "delete_volume" :: held 1.169s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:27 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-58594d5b-7622-4e45-a375-48692f134a4b" returned: 0 in 0.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-quobyte-58594d5b-7622-4e45-a375-48692f134a4b" released by "delete_volume" :: held 1.203s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Created reservations ['b9278ad3-3856-4b91-acac-70fddea45bf3', '607e0350-0a21-49a0-aa9b-a6e776491d1e', '9f236341-03fb-4fe9-82d3-7c9cb52339dc', '88946657-2d18-4a8b-99ca-844cdcd03566'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Created reservations ['8fe5190d-0af6-478f-9ed0-c5e2c4f0d453', '74f2f4d8-8a38-407b-b03c-d49dba24471d', 'a0ee9abe-0633-49fd-b8ef-678717bcdcf6', 'a1b265ce-5569-4176-be5c-085249a95f65'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:27 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:27 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:27 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 1G" returned: 0 in 0.689s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:27 devstack sudo[96488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:27 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:27 devstack sudo[96489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2
Sep 25 11:42:27 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:27 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Deleted volume successfully.
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c186005-00cc-456e-9a7d-7c509ea15d74 tempest-VolumeQuotasNegativeTestJSON-1822592655 None] Lock "cinder-417225e5-5822-4217-89b9-91c6979148e4-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:27 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.344s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Deleted volume successfully.
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99547ef3-d306-44e2-96dd-192f5f39281d tempest-ServerActionsTestOtherA-197499957 None] Lock "cinder-58594d5b-7622-4e45-a375-48692f134a4b-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:27 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2" returned: 0 in 0.419s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:27 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 is being set with open permissions: ugo+rw
Sep 25 11:42:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:27 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2
Sep 25 11:42:27 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:28 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2" returned: 0 in 0.476s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:28 devstack sudo[96508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info
Sep 25 11:42:28 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:28 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info" returned: 0 in 0.637s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:29 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info is being set with open permissions: ugo+rw
Sep 25 11:42:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:29 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info
Sep 25 11:42:29 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:29 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.info" returned: 0 in 0.553s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.653s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c26ce841-0a5d-4130-a342-b0075f7ba247 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Create snapshot completed successfully
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "cinder-7adddbbf-b898-450c-b01a-79b23c2000e2-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-7adddbbf-b898-450c-b01a-79b23c2000e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "cinder-quobyte-7adddbbf-b898-450c-b01a-79b23c2000e2" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-7adddbbf-b898-450c-b01a-79b23c2000e2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Deleting offline snapshot 7adddbbf-b898-450c-b01a-79b23c2000e2 of volume 9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] snapshot_file for this snap is: volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896033a-6464-4223-a80a-2f7c3069463f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:31 devstack sudo[96535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2
Sep 25 11:42:31 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:31 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2" returned: 0 in 0.562s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07bf6b7-22a4-40e6-a93d-4e80321537e2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:32 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6
Sep 25 11:42:32 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:32 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" returned: 0 in 0.628s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:32 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2
Sep 25 11:42:32 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:32 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:32 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2
Sep 25 11:42:32 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:33 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6.7adddbbf-b898-450c-b01a-79b23c2000e2" returned: 0 in 0.428s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-7adddbbf-b898-450c-b01a-79b23c2000e2" released by "_delete_snapshot" :: held 2.264s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" released by "delete_snapshot" :: held 2.301s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:33 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Created reservations ['8b1653f7-209d-4b17-bcc7-dec5f5a28a67', 'e47a747f-2ec1-4ee0-a214-dbd597f2991d', '3d2e0433-f48f-49ad-ba7a-90d752350a2b', '564ec0b4-7ec7-47ff-838f-e1574192a872'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Delete snapshot completed successfully.
Sep 25 11:42:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3eca8ec2-0b0c-4d7e-ba7b-da8c9c95aa05 tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-7adddbbf-b898-450c-b01a-79b23c2000e2-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "cinder-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcba084-79f7-4aa3-8296-c69179026697]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:34 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6
Sep 25 11:42:34 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:35 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" returned: 0 in 0.642s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:35 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6
Sep 25 11:42:35 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:35 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-quobyte-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6" released by "delete_volume" :: held 1.118s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Created reservations ['14709450-9c04-4869-8643-f3da5d533d37', '976eef39-1940-4d12-b1ee-8bd4af64dd8b', '0999286f-6237-416f-8cd4-8e4e18537371', '18e3f8e2-7a0e-4acd-b57d-69212ef67b63'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:35 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:35 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:36 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.401s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:36 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Deleted volume successfully.
Sep 25 11:42:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80dc3226-3091-458f-8857-dc2114130dff tempest-VolumeSnapshotQuotasNegativeTestJSON-314956180 None] Lock "cinder-9e2d0ba7-18f5-46d2-abcb-50d6142f89b6-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Flow 'volume_create_manager' (de8a987a-27a3-4e78-9d0a-eaa8fe260bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56777eca-6786-4ff0-9909-417b75e665a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56777eca-6786-4ff0-9909-417b75e665a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-902868781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a672b4-550d-4e06-bb01-867de23bcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6d73d92c6543c4ba4291bf3de1d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:39Z,use_quota=True,user_id='f429b359cdfb42c3b71a1d233380d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6235275f-1730-438c-991b-1e7d0159338d),volume_type_id=6235275f-1730-438c-991b-1e7d0159338d)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e7cc3-4d80-4215-a8bc-11b84b021ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e7cc3-4d80-4215-a8bc-11b84b021ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f68508-4df4-4bc7-afbd-c281fb2a88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f68508-4df4-4bc7-afbd-c281fb2a88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a672b4-550d-4e06-bb01-867de23bcdd0', 'volume_name': 'volume-15a672b4-550d-4e06-bb01-867de23bcdd0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9579490-c706-4139-b175-ddda68aa22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9579490-c706-4139-b175-ddda68aa22a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f127d06-9e7f-47b6-946d-b4a7dc7e5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:38 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Volume 15a672b4-550d-4e06-bb01-867de23bcdd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a672b4-550d-4e06-bb01-867de23bcdd0', 'volume_size': 1}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-902868781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a672b4-550d-4e06-bb01-867de23bcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6d73d92c6543c4ba4291bf3de1d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:39Z,use_quota=True,user_id='f429b359cdfb42c3b71a1d233380d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6235275f-1730-438c-991b-1e7d0159338d),volume_type_id=6235275f-1730-438c-991b-1e7d0159338d)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Creating volume 15a672b4-550d-4e06-bb01-867de23bcdd0 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:42:38 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:42:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:38 devstack sudo[96577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 1073741824
Sep 25 11:42:38 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:39 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 1073741824" returned: 0 in 0.659s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:39 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0
Sep 25 11:42:39 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:39 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f127d06-9e7f-47b6-946d-b4a7dc7e5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a672b4-550d-4e06-bb01-867de23bcdd0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f260c2-0acb-4fa3-98e5-0919e0ce7e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:39 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Volume volume-15a672b4-550d-4e06-bb01-867de23bcdd0 (15a672b4-550d-4e06-bb01-867de23bcdd0): created successfully
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f260c2-0acb-4fa3-98e5-0919e0ce7e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Flow 'volume_create_manager' (de8a987a-27a3-4e78-9d0a-eaa8fe260bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ae840893-08e6-4303-9172-d4f199c14675 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Created volume successfully.
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:41 devstack sudo[96587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:41 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:42 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.459s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:42 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b58c7612-45bd-47b7-bfcb-dfba8fb10f5c tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Retype volume completed successfully.
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "cinder-15a672b4-550d-4e06-bb01-867de23bcdd0-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "cinder-15a672b4-550d-4e06-bb01-867de23bcdd0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "cinder-quobyte-15a672b4-550d-4e06-bb01-867de23bcdd0" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "cinder-quobyte-15a672b4-550d-4e06-bb01-867de23bcdd0" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5638507-f1b7-4f9b-a564-3ba5ad590fef]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:43 devstack sudo[96605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0
Sep 25 11:42:43 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:43 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0" returned: 0 in 0.596s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:43 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0
Sep 25 11:42:43 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:44 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-15a672b4-550d-4e06-bb01-867de23bcdd0" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "cinder-quobyte-15a672b4-550d-4e06-bb01-867de23bcdd0" released by "delete_volume" :: held 0.958s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:44 devstack cinder-volume[87358]: WARNING cinder.quota [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:42:44 devstack cinder-volume[87358]: WARNING cinder.quota [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Created reservations ['f48ae55e-dfbe-4845-b226-7b01238afac8', 'b1310ca3-5194-4b92-90d8-92c86548727a', 'a62f49c6-4ec6-455d-ba6d-3d9ceb66337a', '2d337c15-a574-432e-9ead-58453c024a35'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:44 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:44 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:44 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.480s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Deleted volume successfully.
Sep 25 11:42:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-69f23e80-6bfa-49fe-be93-bea24941c220 tempest-VolumeRetypeWithoutMigrationTest-106211850 None] Lock "cinder-15a672b4-550d-4e06-bb01-867de23bcdd0-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:51 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:42:51 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:51 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.406s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:42:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:42:54 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=89,cinder:UPDATE=107,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:42:54 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=93,cinder:UPDATE=89,cinder:INSERT=27,cinder:DELETE=13 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:42:56 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:42:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Flow 'volume_create_manager' (97401a03-201b-4b50-bec4-4e2b65707604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e61b55-877d-41cc-bdd2-a743aa73199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e61b55-877d-41cc-bdd2-a743aa73199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1552175973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eeeacb-e397-4838-832f-061d14fe1abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4647d21db6b4ecf81cd11f38e11a008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:57Z,use_quota=True,user_id='5a037b20d9024c48b6d3509bc606a0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3553730b-77fe-4d51-8eaf-4b2d4fefbd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3553730b-77fe-4d51-8eaf-4b2d4fefbd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602878a5-c86d-4cb2-b76c-7f67ca64f1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602878a5-c86d-4cb2-b76c-7f67ca64f1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10eeeacb-e397-4838-832f-061d14fe1abe', 'volume_name': 'volume-10eeeacb-e397-4838-832f-061d14fe1abe', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee561b9-cc18-47f9-ae9f-a960a09eed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee561b9-cc18-47f9-ae9f-a960a09eed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d86176-c7f4-4901-8d66-db6f4c0ac6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Volume 10eeeacb-e397-4838-832f-061d14fe1abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10eeeacb-e397-4838-832f-061d14fe1abe', 'volume_size': 1}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1552175973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eeeacb-e397-4838-832f-061d14fe1abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4647d21db6b4ecf81cd11f38e11a008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:57Z,use_quota=True,user_id='5a037b20d9024c48b6d3509bc606a0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Creating volume 10eeeacb-e397-4838-832f-061d14fe1abe {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:42:57 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:57 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe 1073741824
Sep 25 11:42:57 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:57 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe 1073741824" returned: 0 in 0.681s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:57 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe
Sep 25 11:42:57 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:58 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d86176-c7f4-4901-8d66-db6f4c0ac6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10eeeacb-e397-4838-832f-061d14fe1abe', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef49f79d-3f5d-48a7-a64f-9f7810e2e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:42:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Volume volume-10eeeacb-e397-4838-832f-061d14fe1abe (10eeeacb-e397-4838-832f-061d14fe1abe): created successfully
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef49f79d-3f5d-48a7-a64f-9f7810e2e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:42:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Flow 'volume_create_manager' (97401a03-201b-4b50-bec4-4e2b65707604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:42:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-312d2a3e-cf66-4670-ab93-b537b2e61438 tempest-VolumesServicesTestJSON-1843442762 None] Created volume successfully.
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Acquiring lock "cinder-10eeeacb-e397-4838-832f-061d14fe1abe-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "cinder-10eeeacb-e397-4838-832f-061d14fe1abe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Acquiring lock "cinder-quobyte-10eeeacb-e397-4838-832f-061d14fe1abe" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "cinder-quobyte-10eeeacb-e397-4838-832f-061d14fe1abe" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfeecf0-522a-402c-a499-2952f7184a3a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:59 devstack sudo[96655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe
Sep 25 11:42:59 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:42:59 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe" returned: 0 in 0.519s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:42:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:42:59 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe
Sep 25 11:42:59 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:00 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-10eeeacb-e397-4838-832f-061d14fe1abe" returned: 0 in 0.523s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "cinder-quobyte-10eeeacb-e397-4838-832f-061d14fe1abe" released by "delete_volume" :: held 1.108s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Created reservations ['01a706d2-5333-439e-8075-c957ca6bc914', '8fc3eeaa-f4c5-4df7-b47a-7df9ad194c81', '43698616-88a1-421a-ba4f-cf68e5f1c9d3', 'd5985fa6-723f-4f83-8d84-15c38e1e02d3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:00 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:00 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:01 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:01 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Deleted volume successfully.
Sep 25 11:43:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3de24e4b-d3ff-463d-bde2-91060631057e tempest-VolumesServicesTestJSON-1843442762 None] Lock "cinder-10eeeacb-e397-4838-832f-061d14fe1abe-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (0b63830c-7677-421f-a264-8a1162bfe4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad35c11-aa18-4aaa-b199-36faf13d5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad35c11-aa18-4aaa-b199-36faf13d5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1908037156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03dc42e-7ea0-403e-b462-1dfdee326f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:06Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b75320-03dd-444b-aad5-d1cf79589615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b75320-03dd-444b-aad5-d1cf79589615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37d125-eb8e-48f0-8c43-22accec95ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37d125-eb8e-48f0-8c43-22accec95ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03dc42e-7ea0-403e-b462-1dfdee326f88', 'volume_name': 'volume-f03dc42e-7ea0-403e-b462-1dfdee326f88', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273296b5-e1b1-4310-89c2-a008cbc39273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273296b5-e1b1-4310-89c2-a008cbc39273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc63a1-64f4-42e4-861e-d2a720c6ea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Volume f03dc42e-7ea0-403e-b462-1dfdee326f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03dc42e-7ea0-403e-b462-1dfdee326f88', 'volume_size': 1}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1908037156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03dc42e-7ea0-403e-b462-1dfdee326f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:06Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Creating volume f03dc42e-7ea0-403e-b462-1dfdee326f88 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:06 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:06 devstack sudo[96668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 1073741824
Sep 25 11:43:06 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:06 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 1073741824" returned: 0 in 0.713s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:07 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88
Sep 25 11:43:07 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:07 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88" returned: 0 in 0.344s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc63a1-64f4-42e4-861e-d2a720c6ea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03dc42e-7ea0-403e-b462-1dfdee326f88', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1296ed48-9d62-4f88-8651-0e9a97d6c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Volume volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 (f03dc42e-7ea0-403e-b462-1dfdee326f88): created successfully
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1296ed48-9d62-4f88-8651-0e9a97d6c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (0b63830c-7677-421f-a264-8a1162bfe4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-764f4666-47c7-45cf-ab9c-953f1db9b865 tempest-VolumesListAdminTestJSON-1704259964 None] Created volume successfully.
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (a5abd57b-9d7a-4d27-b571-3f99d69805a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221ac774-8356-4408-b70a-1ca5489dc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221ac774-8356-4408-b70a-1ca5489dc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1716821143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb945eee-a90c-4907-8b0b-92d8e878aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:09Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224fa461-c994-4a4f-9df8-cdf61b0aec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224fa461-c994-4a4f-9df8-cdf61b0aec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5984396-7b48-43c2-a782-1b2e656f1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5984396-7b48-43c2-a782-1b2e656f1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb945eee-a90c-4907-8b0b-92d8e878aca2', 'volume_name': 'volume-cb945eee-a90c-4907-8b0b-92d8e878aca2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756ffa65-be98-478d-a8ef-2b51b6e9f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756ffa65-be98-478d-a8ef-2b51b6e9f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b61bff-6d93-44d8-9843-35b94d44a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:09 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Volume cb945eee-a90c-4907-8b0b-92d8e878aca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb945eee-a90c-4907-8b0b-92d8e878aca2', 'volume_size': 1}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1716821143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb945eee-a90c-4907-8b0b-92d8e878aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:09Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Creating volume cb945eee-a90c-4907-8b0b-92d8e878aca2 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:09 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:09 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 1073741824
Sep 25 11:43:09 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:10 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 1073741824" returned: 0 in 0.773s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:10 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2
Sep 25 11:43:10 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:10 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b61bff-6d93-44d8-9843-35b94d44a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb945eee-a90c-4907-8b0b-92d8e878aca2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d840e0-a31e-4139-b1a6-570d9c809440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:10 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Volume volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 (cb945eee-a90c-4907-8b0b-92d8e878aca2): created successfully
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d840e0-a31e-4139-b1a6-570d9c809440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (a5abd57b-9d7a-4d27-b571-3f99d69805a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2ae0e082-e735-4a5e-a0b8-e6881581e424 tempest-VolumesListAdminTestJSON-1704259964 None] Created volume successfully.
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (087e7f25-1f4f-4443-978e-2ffaa55adeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2761a4-2a06-476a-81db-448c830e895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2761a4-2a06-476a-81db-448c830e895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2118037497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c972a92-e64f-4ea0-a514-c31963e9c536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:12Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d186d58a-5895-44e5-acdd-a0c19902fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d186d58a-5895-44e5-acdd-a0c19902fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ae2b30-b87a-4c11-9495-dd76875a3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ae2b30-b87a-4c11-9495-dd76875a3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c972a92-e64f-4ea0-a514-c31963e9c536', 'volume_name': 'volume-6c972a92-e64f-4ea0-a514-c31963e9c536', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f586f6-4581-41e7-a7fb-93811a023e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f586f6-4581-41e7-a7fb-93811a023e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25182fb-09f6-40d3-a8d6-1181b627f72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Volume 6c972a92-e64f-4ea0-a514-c31963e9c536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c972a92-e64f-4ea0-a514-c31963e9c536', 'volume_size': 1}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2118037497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c972a92-e64f-4ea0-a514-c31963e9c536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01662fb969af4e479fd8d9ad2a500377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:12Z,use_quota=True,user_id='b73d512121f24d5a9061f6c2ca75bd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Creating volume 6c972a92-e64f-4ea0-a514-c31963e9c536 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:12 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:12 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 1073741824
Sep 25 11:43:12 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:13 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 1073741824" returned: 0 in 0.773s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:13 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536
Sep 25 11:43:13 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:13 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536" returned: 0 in 0.473s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25182fb-09f6-40d3-a8d6-1181b627f72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c972a92-e64f-4ea0-a514-c31963e9c536', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7189ae-eaac-492b-87a7-eb92cc312696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:13 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Volume volume-6c972a92-e64f-4ea0-a514-c31963e9c536 (6c972a92-e64f-4ea0-a514-c31963e9c536): created successfully
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7189ae-eaac-492b-87a7-eb92cc312696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Flow 'volume_create_manager' (087e7f25-1f4f-4443-978e-2ffaa55adeb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ce24b979-4162-4b9c-9a98-edc3c8197db7 tempest-VolumesListAdminTestJSON-1704259964 None] Created volume successfully.
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Flow 'volume_create_manager' (dbbc4afb-1060-4df5-ad37-034ca03fa865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa239b44-c07a-4bbb-8adb-3ccc467bb99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa239b44-c07a-4bbb-8adb-3ccc467bb99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc62a60-f3b7-486e-a3ee-448de7eea56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17c5fd2a574b149a6f1a2b55ffcc04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:15Z,use_quota=True,user_id='53a3d4da2f1a4adba8c281e166bf0621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939e19b8-c68a-4b05-9781-a0931c45e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939e19b8-c68a-4b05-9781-a0931c45e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b7382b-bfa2-4b49-8b6a-ca18cc3fa6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b7382b-bfa2-4b49-8b6a-ca18cc3fa6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc62a60-f3b7-486e-a3ee-448de7eea56d', 'volume_name': 'volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb5ce93-8531-433c-b08e-06f621746be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb5ce93-8531-433c-b08e-06f621746be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3904b4e0-44e5-4751-8442-d7ea39f7a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:15 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Volume 2bc62a60-f3b7-486e-a3ee-448de7eea56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d', 'volume_size': 1}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc62a60-f3b7-486e-a3ee-448de7eea56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17c5fd2a574b149a6f1a2b55ffcc04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:15Z,use_quota=True,user_id='53a3d4da2f1a4adba8c281e166bf0621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Creating volume 2bc62a60-f3b7-486e-a3ee-448de7eea56d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:15 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:15 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d 1073741824
Sep 25 11:43:15 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:16 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d 1073741824" returned: 0 in 0.743s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:16 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d
Sep 25 11:43:16 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:16 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3904b4e0-44e5-4751-8442-d7ea39f7a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17604e46-5c94-4977-a740-8f7b0530f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:17 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Volume volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d (2bc62a60-f3b7-486e-a3ee-448de7eea56d): created successfully
Sep 25 11:43:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17604e46-5c94-4977-a740-8f7b0530f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Flow 'volume_create_manager' (dbbc4afb-1060-4df5-ad37-034ca03fa865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2b42ec92-207d-4061-943e-4871720cce20 tempest-VolumesListAdminTestJSON-110500685 None] Created volume successfully.
Sep 25 11:43:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Acquiring lock "cinder-2bc62a60-f3b7-486e-a3ee-448de7eea56d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "cinder-2bc62a60-f3b7-486e-a3ee-448de7eea56d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Acquiring lock "cinder-quobyte-2bc62a60-f3b7-486e-a3ee-448de7eea56d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "cinder-quobyte-2bc62a60-f3b7-486e-a3ee-448de7eea56d" acquired by "delete_volume" :: waited 0.081s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b9b81-7d2a-4b8b-8386-7a573a8f722b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-6c972a92-e64f-4ea0-a514-c31963e9c536-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-6c972a92-e64f-4ea0-a514-c31963e9c536-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:18 devstack sudo[96780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d
Sep 25 11:43:18 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-quobyte-6c972a92-e64f-4ea0-a514-c31963e9c536" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-6c972a92-e64f-4ea0-a514-c31963e9c536" acquired by "delete_volume" :: waited 0.048s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6dd01-3ec6-4560-ba34-758d556b7235]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:18 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536
Sep 25 11:43:18 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:18 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d" returned: 0 in 0.671s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:18 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d
Sep 25 11:43:18 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:19 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2bc62a60-f3b7-486e-a3ee-448de7eea56d" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "cinder-quobyte-2bc62a60-f3b7-486e-a3ee-448de7eea56d" released by "delete_volume" :: held 1.275s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:19 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536" returned: 0 in 0.894s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:19 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536
Sep 25 11:43:19 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Created reservations ['bcb67a41-7c41-4ebc-8a39-d17afd2c448e', '2de12fdf-b6f4-4d04-9d42-147c91b772bc', '40dfbe14-699a-4e2c-b603-17313b99c49b', '205bd5e8-95d9-4f7d-bcc5-82eb98c6a3de'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:19 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:19 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:19 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6c972a92-e64f-4ea0-a514-c31963e9c536" returned: 0 in 0.564s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-6c972a92-e64f-4ea0-a514-c31963e9c536" released by "delete_volume" :: held 1.555s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Created reservations ['89926c2e-4448-494f-b8b4-bbbc412ef522', 'fabbac2f-422b-4366-8a9e-b902de9f5572', '74bd7732-fc90-4184-9cee-9755c24e213a', '2c6aac00-7001-4cfa-947e-92e00833db9b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:20 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:20 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:20 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.646s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:20 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Deleted volume successfully.
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-754b1c65-6b3d-4e52-9967-30508441eb3c tempest-VolumesListAdminTestJSON-110500685 None] Lock "cinder-2bc62a60-f3b7-486e-a3ee-448de7eea56d-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-cb945eee-a90c-4907-8b0b-92d8e878aca2-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-cb945eee-a90c-4907-8b0b-92d8e878aca2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:20 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.648s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:20 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Deleted volume successfully.
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-quobyte-cb945eee-a90c-4907-8b0b-92d8e878aca2" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-38810bfd-bb91-4002-932d-3d1831ab2e52 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-6c972a92-e64f-4ea0-a514-c31963e9c536-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-cb945eee-a90c-4907-8b0b-92d8e878aca2" acquired by "delete_volume" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[79706db6-09ca-403f-bcea-a2f54499bfda]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:21 devstack sudo[96832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2
Sep 25 11:43:21 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:21 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2" returned: 0 in 0.755s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:22 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2
Sep 25 11:43:22 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:22 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb945eee-a90c-4907-8b0b-92d8e878aca2" returned: 0 in 0.455s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-cb945eee-a90c-4907-8b0b-92d8e878aca2" released by "delete_volume" :: held 1.405s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Created reservations ['609a555c-6501-4cf0-b4ac-03a8eee43a4a', '91a4ad52-2d70-4029-8cd9-5e23d72358f2', '56719c21-dfd8-452b-bbc4-392f3fa7fe19', '6fb0d8f4-bef5-4c50-af8f-b394b31da1cc'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:22 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:22 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:23 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Deleted volume successfully.
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90b0a592-545e-46d9-984b-5d3686b11ea5 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-cb945eee-a90c-4907-8b0b-92d8e878aca2-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-f03dc42e-7ea0-403e-b462-1dfdee326f88-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-f03dc42e-7ea0-403e-b462-1dfdee326f88-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "cinder-quobyte-f03dc42e-7ea0-403e-b462-1dfdee326f88" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-f03dc42e-7ea0-403e-b462-1dfdee326f88" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d7f5a-beaf-4fb9-b4ee-1a07ac645c32]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:24 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88
Sep 25 11:43:24 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:24 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88" returned: 0 in 0.822s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:24 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88
Sep 25 11:43:24 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:25 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f03dc42e-7ea0-403e-b462-1dfdee326f88" returned: 0 in 0.665s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-quobyte-f03dc42e-7ea0-403e-b462-1dfdee326f88" released by "delete_volume" :: held 1.572s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Created reservations ['8fdb5f82-4056-4b9d-b7d6-ae488b8042e7', '0d7c9643-e6b0-4249-97e3-4618e17da0c8', '128d9e44-a0cd-4520-b42e-a22dab97d3d1', '06e6cb7d-9053-4f8f-94b3-17d5ecc83582'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:25 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:25 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:25 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Deleted volume successfully.
Sep 25 11:43:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1eda48f5-0169-4609-bc87-66a177c8d217 tempest-VolumesListAdminTestJSON-1704259964 None] Lock "cinder-f03dc42e-7ea0-403e-b462-1dfdee326f88-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Flow 'volume_create_manager' (b12539a2-f479-4226-84fc-802f0b7de87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ff7d17-1ea3-4254-9653-1431061549f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ff7d17-1ea3-4254-9653-1431061549f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-973247407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba2cbf4-89a2-41f6-b1af-bf296830eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c5a49c4e44f439458a2acd449eee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:35Z,use_quota=True,user_id='d02ec242c6d24878b4790b13b701db3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbea437-6d37-4690-bcb6-50dce0f84391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbea437-6d37-4690-bcb6-50dce0f84391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99133fd-78f9-483b-8b5d-2a71df550d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99133fd-78f9-483b-8b5d-2a71df550d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba2cbf4-89a2-41f6-b1af-bf296830eb43', 'volume_name': 'volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bf4a88-2b90-4efb-b5b0-fc7d447777c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bf4a88-2b90-4efb-b5b0-fc7d447777c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852610ce-fe84-4f87-be82-99f64f024389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Volume 5ba2cbf4-89a2-41f6-b1af-bf296830eb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43', 'volume_size': 1}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-973247407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba2cbf4-89a2-41f6-b1af-bf296830eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c5a49c4e44f439458a2acd449eee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:35Z,use_quota=True,user_id='d02ec242c6d24878b4790b13b701db3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Creating volume 5ba2cbf4-89a2-41f6-b1af-bf296830eb43 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:35 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:35 devstack sudo[96908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 1073741824
Sep 25 11:43:35 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:36 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 1073741824" returned: 0 in 0.821s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:36 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43
Sep 25 11:43:36 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:36 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" returned: 0 in 0.430s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852610ce-fe84-4f87-be82-99f64f024389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acd794a-1917-4fd9-8b27-f326a729bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Volume volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 (5ba2cbf4-89a2-41f6-b1af-bf296830eb43): created successfully
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acd794a-1917-4fd9-8b27-f326a729bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Flow 'volume_create_manager' (b12539a2-f479-4226-84fc-802f0b7de87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-87dd435e-4ea3-42c3-9860-4757fba40445 tempest-VolumesTransfersV357Test-1116377353 None] Created volume successfully.
Sep 25 11:43:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4af5a9bf-9d74-4791-8b69-bbcb6bcd0f3d tempest-VolumesTransfersV357Test-396022526 None] Transfer volume completed successfully.
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "cinder-5ba2cbf4-89a2-41f6-b1af-bf296830eb43-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-5ba2cbf4-89a2-41f6-b1af-bf296830eb43-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "cinder-quobyte-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-quobyte-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb159c-dcd5-454f-9840-be7102b6c5ec]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:39 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43
Sep 25 11:43:39 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:40 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" returned: 0 in 0.558s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:40 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43
Sep 25 11:43:40 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:40 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" returned: 0 in 0.343s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-quobyte-5ba2cbf4-89a2-41f6-b1af-bf296830eb43" released by "delete_volume" :: held 0.960s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Created reservations ['113c7288-f987-444e-ad2b-6ad56543305e', '5ed44b84-1f07-4efe-bf3a-9221e2e3dab1', '9628d150-d17a-4cb9-9293-6f093bca4e31', '6e666d98-ab7d-4049-b458-6a18a3dc5e59'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:40 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:40 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:40 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.366s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:40 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Deleted volume successfully.
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4572d310-9568-4246-827d-b1ff00ce38f1 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-5ba2cbf4-89a2-41f6-b1af-bf296830eb43-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Flow 'volume_create_manager' (d5600f92-1ca5-4ba8-b513-3c76d56a64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1fec44-87c7-4835-a477-1228ab01b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1fec44-87c7-4835-a477-1228ab01b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-212844375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33514946-e011-4792-b2a9-367aa16de541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5af1a3152f4c138b88da484156c05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:41Z,use_quota=True,user_id='8838505a6ed9412ead9fbdb439d13fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9328ff5a-6e3c-4540-bd76-09ed730daff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9328ff5a-6e3c-4540-bd76-09ed730daff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eae02b-edde-4613-a888-e234fb0ea375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eae02b-edde-4613-a888-e234fb0ea375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33514946-e011-4792-b2a9-367aa16de541', 'volume_name': 'volume-33514946-e011-4792-b2a9-367aa16de541', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63996d0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d44084e-1dd5-4ed5-a24f-ddc17a7a1236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d44084e-1dd5-4ed5-a24f-ddc17a7a1236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963c23b0-de60-4923-aeb8-049a9d2df6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:41 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Volume 33514946-e011-4792-b2a9-367aa16de541: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33514946-e011-4792-b2a9-367aa16de541', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63996d0>}
Sep 25 11:43:41 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Trying to clone 33514946-e011-4792-b2a9-367aa16de541 from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Flow 'volume_create_manager' (ecee835e-55ab-437c-9d2d-0ac0fed6a6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d2bb3a-8236-4f98-adcb-4b4a594a9696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:43:42 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d2bb3a-8236-4f98-adcb-4b4a594a9696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1310957881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ac0237-8548-4050-bf4e-a9e7b97cc7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c5a49c4e44f439458a2acd449eee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:42Z,use_quota=True,user_id='d02ec242c6d24878b4790b13b701db3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98be13bd-c34f-4044-b6cc-b4c2183c8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98be13bd-c34f-4044-b6cc-b4c2183c8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053fe29-bde0-491d-ad7c-6842f60e695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053fe29-bde0-491d-ad7c-6842f60e695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ac0237-8548-4050-bf4e-a9e7b97cc7d2', 'volume_name': 'volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc1748-ee45-4df9-bd94-b7e9def128d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc1748-ee45-4df9-bd94-b7e9def128d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3725aef9-1572-4279-8f4e-2c47a239f89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:42 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Volume 50ac0237-8548-4050-bf4e-a9e7b97cc7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2', 'volume_size': 1}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1310957881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ac0237-8548-4050-bf4e-a9e7b97cc7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c5a49c4e44f439458a2acd449eee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:42Z,use_quota=True,user_id='d02ec242c6d24878b4790b13b701db3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Creating volume 50ac0237-8548-4050-bf4e-a9e7b97cc7d2 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:42 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:42 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 1073741824
Sep 25 11:43:42 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[376aeda9-3282-4eb5-b51d-6e4e028b7b73]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:42 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD
Sep 25 11:43:42 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Flow 'volume_create_manager' (e6e9a850-bbb6-4064-ae8d-274ea6e92c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c269ee-19cb-4a96-999c-f216b8044073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c269ee-19cb-4a96-999c-f216b8044073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2006449539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206c614f-7079-4857-89eb-42e3ac3a6b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f5fcf1e3efe47078fb5605a9a502793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:43Z,use_quota=True,user_id='27645bca85dc4eddbde372532330f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5403e86-b5fb-4bc1-a2e1-94821277bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5403e86-b5fb-4bc1-a2e1-94821277bf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a3046-8563-4d76-9664-6e6572c65bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a3046-8563-4d76-9664-6e6572c65bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206c614f-7079-4857-89eb-42e3ac3a6b8c', 'volume_name': 'volume-206c614f-7079-4857-89eb-42e3ac3a6b8c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213aa8a5-09ab-41c4-baab-19f7fb73e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213aa8a5-09ab-41c4-baab-19f7fb73e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8bb2b8-4edd-43c1-8d85-915b825951c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Volume 206c614f-7079-4857-89eb-42e3ac3a6b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206c614f-7079-4857-89eb-42e3ac3a6b8c', 'volume_size': 1}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD" returned: 0 in 0.703s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 is fetched for user 8838505a6ed9412ead9fbdb439d13fb0. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:43:43 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 1073741824" returned: 0 in 0.767s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:43 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2
Sep 25 11:43:43 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1f821d-3886-4879-82ea-2d59e7a8fe03]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:43 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD
Sep 25 11:43:43 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:43 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" returned: 0 in 0.343s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2006449539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206c614f-7079-4857-89eb-42e3ac3a6b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f5fcf1e3efe47078fb5605a9a502793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:43Z,use_quota=True,user_id='27645bca85dc4eddbde372532330f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Creating volume 206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:43 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3725aef9-1572-4279-8f4e-2c47a239f89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c 1073741824
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874e151f-a273-409e-8689-08cbb3b93ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:43 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:43 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Volume volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 (50ac0237-8548-4050-bf4e-a9e7b97cc7d2): created successfully
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874e151f-a273-409e-8689-08cbb3b93ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Flow 'volume_create_manager' (ecee835e-55ab-437c-9d2d-0ac0fed6a6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-de0e338c-adf1-43e3-aa43-db7ad64809de tempest-VolumesTransfersV357Test-1116377353 None] Created volume successfully.
Sep 25 11:43:43 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:44 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c 1073741824" returned: 0 in 0.642s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:44 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c
Sep 25 11:43:44 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:44 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c" returned: 0 in 0.314s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-212844375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33514946-e011-4792-b2a9-367aa16de541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5af1a3152f4c138b88da484156c05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:41Z,use_quota=True,user_id='8838505a6ed9412ead9fbdb439d13fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Creating volume 33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:44 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8bb2b8-4edd-43c1-8d85-915b825951c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206c614f-7079-4857-89eb-42e3ac3a6b8c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:44 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1073741824
Sep 25 11:43:44 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a7ac81-da8e-470c-ac2c-702d75c4204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:44 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Volume volume-206c614f-7079-4857-89eb-42e3ac3a6b8c (206c614f-7079-4857-89eb-42e3ac3a6b8c): created successfully
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a7ac81-da8e-470c-ac2c-702d75c4204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Flow 'volume_create_manager' (e6e9a850-bbb6-4064-ae8d-274ea6e92c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-89bb5a0a-a68a-48d7-90d3-7acbcbca0227 tempest-SnapshotMetadataTestJSON-1735260770 None] Created volume successfully.
Sep 25 11:43:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "cinder-50ac0237-8548-4050-bf4e-a9e7b97cc7d2-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-50ac0237-8548-4050-bf4e-a9e7b97cc7d2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "cinder-quobyte-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-quobyte-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530cc75-dfc4-430d-a017-4910966e14a9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:45 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2
Sep 25 11:43:45 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:45 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1073741824" returned: 0 in 0.706s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:45 devstack sudo[97009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541
Sep 25 11:43:45 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:45 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" returned: 0 in 0.580s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:45 devstack sudo[97011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2
Sep 25 11:43:45 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:45 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.287s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Creating offline snapshot 9730397f-a14c-41e2-bc62-c52dd8bc8dc6 of volume 206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:43:46 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0435d-2248-4bdd-94ed-bb967ae95d63]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Attempting download of 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 33514946-e011-4792-b2a9-367aa16de541. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" returned: 0 in 0.338s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-quobyte-50ac0237-8548-4050-bf4e-a9e7b97cc7d2" released by "delete_volume" :: held 0.974s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1e24ac-462b-453b-a28b-4e7fd3e27ecc]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Created reservations ['97db0ef0-7724-4951-8b73-04f82981fb9c', 'f0ad4d53-d29c-497c-8979-5a07c7915ed1', 'e7994714-d653-4076-b6c7-a4b51fe7b347', 'f389cc6e-1b02-4003-91c3-1edd2c0bbb56'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:46 devstack sudo[97015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c
Sep 25 11:43:46 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:43:46 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj
Sep 25 11:43:46 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Flow 'volume_create_manager' (753882f8-b51e-4ac3-8ddd-084cb6f856f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1252c55-005a-4ec4-bd1e-7c49e9e684d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1252c55-005a-4ec4-bd1e-7c49e9e684d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-516498066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b714ff-7dfa-46bd-abd5-0c0419dda3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838b9b79347949e89b360655a9ca0c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:46Z,use_quota=True,user_id='ac4354250b6f41b3863af1bb4be04828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c34e46-6a17-4108-9ab8-e4852fb92e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c34e46-6a17-4108-9ab8-e4852fb92e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c33bd6-166f-40e8-b892-a5dd29295b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c33bd6-166f-40e8-b892-a5dd29295b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b714ff-7dfa-46bd-abd5-0c0419dda3e0', 'volume_name': 'volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8bdd2c-0308-42c3-9194-d3b0fa905e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8bdd2c-0308-42c3-9194-d3b0fa905e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8755ac-b31f-4714-af40-ef6f6123c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:46 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Volume d5b714ff-7dfa-46bd-abd5-0c0419dda3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0', 'volume_size': 1}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack sudo[97020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:46 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:46 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c" returned: 0 in 0.457s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack sudo[97026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 1G
Sep 25 11:43:46 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:46 devstack sudo[97028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj
Sep 25 11:43:46 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:46 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.311s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:46 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Deleted volume successfully.
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a406a965-1f52-4943-85f0-4c88b0d7e0e2 tempest-VolumesTransfersV357Test-161056484 None] Lock "cinder-50ac0237-8548-4050-bf4e-a9e7b97cc7d2-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:46 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj" returned: 1 in 0.447s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_jnqeh4uj' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[180556c2-7cd4-4af4-8051-39c5b4b43dfd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:46 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 1G" returned: 0 in 0.513s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206c614f-7079-4857-89eb-42e3ac3a6b8c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:47 devstack sudo[97038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206c614f-7079-4857-89eb-42e3ac3a6b8c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6
Sep 25 11:43:47 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:47 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD
Sep 25 11:43:47 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:47 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206c614f-7079-4857-89eb-42e3ac3a6b8c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6" returned: 0 in 0.380s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:47 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 is being set with open permissions: ugo+rw
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:47 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6
Sep 25 11:43:47 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:47 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] 5646eeca-3c92-4e68-971d-05dbb021a3a9 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:47 devstack sudo[97051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541
Sep 25 11:43:47 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:47 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6" returned: 0 in 0.321s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:47 devstack sudo[97057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info
Sep 25 11:43:47 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:48 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:48 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info is being set with open permissions: ugo+rw
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:48 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info
Sep 25 11:43:48 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:48 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.info" returned: 0 in 0.361s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-516498066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b714ff-7dfa-46bd-abd5-0c0419dda3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838b9b79347949e89b360655a9ca0c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:46Z,use_quota=True,user_id='ac4354250b6f41b3863af1bb4be04828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Creating volume d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:43:48 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:43:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:48 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 1073741824
Sep 25 11:43:48 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c97c0c87-f461-4188-8998-518d38078642 tempest-SnapshotMetadataTestJSON-1735260770 None] Create snapshot completed successfully
Sep 25 11:43:49 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 1073741824" returned: 0 in 0.684s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:49 devstack sudo[97071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0
Sep 25 11:43:49 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:49 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" returned: 0 in 0.476s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8755ac-b31f-4714-af40-ef6f6123c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d80b24-59ba-434d-bb16-f005c85b5068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Volume volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 (d5b714ff-7dfa-46bd-abd5-0c0419dda3e0): created successfully
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d80b24-59ba-434d-bb16-f005c85b5068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Flow 'volume_create_manager' (753882f8-b51e-4ac3-8ddd-084cb6f856f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7efea7b2-9530-4d3d-a69e-d09aa582e465 tempest-AttachVolumeShelveTestJSON-83704501 None] Created volume successfully.
Sep 25 11:43:50 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541" returned: 0 in 2.744s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9__j6cqkt5devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:43:50 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Converted 112.00 MB image at 40.80 MB/s
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:50 devstack sudo[97074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1G
Sep 25 11:43:50 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "cinder-9730397f-a14c-41e2-bc62-c52dd8bc8dc6-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-9730397f-a14c-41e2-bc62-c52dd8bc8dc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "cinder-quobyte-9730397f-a14c-41e2-bc62-c52dd8bc8dc6" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-9730397f-a14c-41e2-bc62-c52dd8bc8dc6" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Deleting offline snapshot 9730397f-a14c-41e2-bc62-c52dd8bc8dc6 of volume 206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:43:50 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] snapshot_file for this snap is: volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 1G" returned: 0 in 0.550s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Downloaded image 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 33514946-e011-4792-b2a9-367aa16de541 successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 for user 8838505a6ed9412ead9fbdb439d13fb0 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Marking volume 33514946-e011-4792-b2a9-367aa16de541 as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f6308-073a-4d98-8af2-4473ba900048]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Copying metadata from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 to 33514946-e011-4792-b2a9-367aa16de541. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Creating volume glance metadata for volume 33514946-e011-4792-b2a9-367aa16de541 backed by image 5646eeca-3c92-4e68-971d-05dbb021a3a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963c23b0-de60-4923-aeb8-049a9d2df6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33514946-e011-4792-b2a9-367aa16de541', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63996d0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:50 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6
Sep 25 11:43:50 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85085a7b-4351-49cc-b8de-9ce7e8730ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:43:50 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Volume volume-33514946-e011-4792-b2a9-367aa16de541 (33514946-e011-4792-b2a9-367aa16de541): created successfully
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85085a7b-4351-49cc-b8de-9ce7e8730ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:43:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Flow 'volume_create_manager' (d5600f92-1ca5-4ba8-b513-3c76d56a64a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:43:51 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cfeffec3-36d3-4dc0-8b75-36013d6366fc tempest-TestShelveInstance-1084034660 None] Created volume successfully.
Sep 25 11:43:51 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6" returned: 0 in 0.647s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-206c614f-7079-4857-89eb-42e3ac3a6b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[af066657-e75e-426e-b681-80c850e7a6ba]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:51 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:51 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:51 devstack sudo[97091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c
Sep 25 11:43:51 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:52 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.537s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:43:52 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c" returned: 0 in 0.710s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:52 devstack sudo[97100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6
Sep 25 11:43:52 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:52 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6" returned: 0 in 0.525s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:52 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6
Sep 25 11:43:52 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:53 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c.9730397f-a14c-41e2-bc62-c52dd8bc8dc6" returned: 0 in 0.523s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-9730397f-a14c-41e2-bc62-c52dd8bc8dc6" released by "_delete_snapshot" :: held 2.633s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" released by "delete_snapshot" :: held 2.680s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Created reservations ['d2c73c03-9f61-4906-a5ca-92b97ac4b7ff', 'a413c87a-2056-49d7-ab95-26d8c8f39068', 'e241bd7e-8dd0-4810-90cc-9bf369c5032e', 'fde424dc-b7f7-48e2-a02e-812c1ecd6e21'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Delete snapshot completed successfully.
Sep 25 11:43:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cc3f2e7c-0b12-45e9-8c7a-7b6d5e22795d tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-9730397f-a14c-41e2-bc62-c52dd8bc8dc6-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "cinder-206c614f-7079-4857-89eb-42e3ac3a6b8c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-206c614f-7079-4857-89eb-42e3ac3a6b8c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5a827-0934-400c-b777-6ac786c8ae20]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:43:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:54 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c
Sep 25 11:43:54 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:55 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c" returned: 0 in 0.782s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:55 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c
Sep 25 11:43:55 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:55 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206c614f-7079-4857-89eb-42e3ac3a6b8c" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-quobyte-206c614f-7079-4857-89eb-42e3ac3a6b8c" released by "delete_volume" :: held 1.430s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=85,cinder:UPDATE=96,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=63,cinder:UPDATE=94,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Created reservations ['f2347edb-00fc-4154-aaf7-9c5b777cf36e', 'a9a1b8c5-aef6-4d66-83db-649d2e20041e', 'b7038145-98c0-4375-ac46-cbc3b731a4bb', 'c8b7aade-1d27-4a08-85a0-35c0544945b3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:43:55 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:43:55 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d8eb48bc-cf13-41b9-9fb1-9cc756d9eaa6 req-1a980869-e96f-4324-89d6-b860df7f2e39 tempest-TestShelveInstance-1084034660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:43:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d8eb48bc-cf13-41b9-9fb1-9cc756d9eaa6 req-1a980869-e96f-4324-89d6-b860df7f2e39 tempest-TestShelveInstance-1084034660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:43:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d8eb48bc-cf13-41b9-9fb1-9cc756d9eaa6 req-1a980869-e96f-4324-89d6-b860df7f2e39 tempest-TestShelveInstance-1084034660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:43:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-d8eb48bc-cf13-41b9-9fb1-9cc756d9eaa6 req-1a980869-e96f-4324-89d6-b860df7f2e39 tempest-TestShelveInstance-1084034660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-33514946-e011-4792-b2a9-367aa16de541', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1bbb831-2098-4ec1-a0fb-a1745ae716ec', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:43:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-d8eb48bc-cf13-41b9-9fb1-9cc756d9eaa6 req-1a980869-e96f-4324-89d6-b860df7f2e39 tempest-TestShelveInstance-1084034660 None] attachment_update completed successfully.
Sep 25 11:43:56 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Sep 25 11:43:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.498s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:43:56 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:43:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Deleted volume successfully.
Sep 25 11:43:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d39ac9be-2267-467f-8ac5-aed314b8a9a9 tempest-SnapshotMetadataTestJSON-1735260770 None] Lock "cinder-206c614f-7079-4857-89eb-42e3ac3a6b8c-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Flow 'volume_create_manager' (e9d1cf34-131e-41b5-8cb2-c4edca55d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230e6bd7-9ca9-4814-9574-3b5c9df8810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230e6bd7-9ca9-4814-9574-3b5c9df8810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1380975347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d54769-3727-49b5-8b54-f8d5c8124885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ac07403c384a9390116d5cb6cc1b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:06Z,use_quota=True,user_id='d0a3056d9bbe4df6b152c54a409bfd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc56577f-5c28-4914-b8bf-37e8d0752cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc56577f-5c28-4914-b8bf-37e8d0752cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6074c7-34a5-41e7-83bf-8571a10d2df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:05 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:44:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6074c7-34a5-41e7-83bf-8571a10d2df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14d54769-3727-49b5-8b54-f8d5c8124885', 'volume_name': 'volume-14d54769-3727-49b5-8b54-f8d5c8124885', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65b6060>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9be5bd-75a6-4c5c-ae65-de11de2bf948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9be5bd-75a6-4c5c-ae65-de11de2bf948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63786bdf-d8ef-4496-85b9-7f19026b459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Volume 14d54769-3727-49b5-8b54-f8d5c8124885: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14d54769-3727-49b5-8b54-f8d5c8124885', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65b6060>}
Sep 25 11:44:06 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Trying to clone 14d54769-3727-49b5-8b54-f8d5c8124885 from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:44:07 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:44:07 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 11:44:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a0c17-ab3b-46ee-8839-8c3c2b771c7b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:08 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD
Sep 25 11:44:08 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:08 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:08 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 is fetched for user d0a3056d9bbe4df6b152c54a409bfd5c. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:44:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b8c5a3-3427-41e2-a06e-a192fb71695d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:09 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD
Sep 25 11:44:09 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-bbffddbe-203e-46ce-aead-b6d315250802 req-a3d34cdf-a40e-4b08-9b97-d2ec0aa814b6 tempest-AttachVolumeShelveTestJSON-83704501 None] No connector for attachment fa3da785-b228-4f76-bf18-a0551691953f; skipping storage backend terminate_connection call. {{(pid=87358) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 25 11:44:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-bbffddbe-203e-46ce-aead-b6d315250802 req-a3d34cdf-a40e-4b08-9b97-d2ec0aa814b6 tempest-AttachVolumeShelveTestJSON-83704501 None] Deleting attachment fa3da785-b228-4f76-bf18-a0551691953f. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:44:10 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD" returned: 0 in 1.276s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1380975347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d54769-3727-49b5-8b54-f8d5c8124885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ac07403c384a9390116d5cb6cc1b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:06Z,use_quota=True,user_id='d0a3056d9bbe4df6b152c54a409bfd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Creating volume 14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:44:10 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:44:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:10 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1073741824
Sep 25 11:44:10 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:11 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1073741824" returned: 0 in 1.132s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:11 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885
Sep 25 11:44:11 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:11 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885" returned: 0 in 0.444s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Attempting download of 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 14d54769-3727-49b5-8b54-f8d5c8124885. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdefd85-24fd-49d5-a096-1f0653b2991c]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:12 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc
Sep 25 11:44:12 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:12 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc" returned: 0 in 0.526s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:12 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc
Sep 25 11:44:12 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:13 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc" returned: 1 in 0.909s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_nogfrqtc' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[27729d43-e54c-4114-a7a7-d95f0e3baf9c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:13 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD
Sep 25 11:44:13 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:13 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] 5646eeca-3c92-4e68-971d-05dbb021a3a9 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:44:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:14 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885
Sep 25 11:44:14 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:17 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885" returned: 0 in 3.272s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_ppzdnr1odevstack@QuobyteHD, size 112.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:44:17 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Converted 112.00 MB image at 34.22 MB/s
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:17 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1G
Sep 25 11:44:17 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:17 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 1G" returned: 0 in 0.574s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Downloaded image 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume 14d54769-3727-49b5-8b54-f8d5c8124885 successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 for user d0a3056d9bbe4df6b152c54a409bfd5c is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Marking volume 14d54769-3727-49b5-8b54-f8d5c8124885 as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Copying metadata from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 to 14d54769-3727-49b5-8b54-f8d5c8124885. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:44:17 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Creating volume glance metadata for volume 14d54769-3727-49b5-8b54-f8d5c8124885 backed by image 5646eeca-3c92-4e68-971d-05dbb021a3a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:44:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63786bdf-d8ef-4496-85b9-7f19026b459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14d54769-3727-49b5-8b54-f8d5c8124885', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d65b6060>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdae3ab-efe4-4da8-a223-f77b63ad7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Volume volume-14d54769-3727-49b5-8b54-f8d5c8124885 (14d54769-3727-49b5-8b54-f8d5c8124885): created successfully
Sep 25 11:44:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdae3ab-efe4-4da8-a223-f77b63ad7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Flow 'volume_create_manager' (e9d1cf34-131e-41b5-8cb2-c4edca55d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8ccc7f7c-7e5a-4755-9371-7718809af99e tempest-VolumesExtendTest-1909651577 None] Created volume successfully.
Sep 25 11:44:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a14329-1c01-4b5f-96ce-2c8f58e08b46]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:19 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885
Sep 25 11:44:19 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:20 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885" returned: 0 in 0.658s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 2G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 2G" returned: 0 in 0.192s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.898s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:20 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b0d7b647-5543-483c-b2c8-733990cf29f4 tempest-VolumesExtendTest-1909651577 None] Extend volume completed successfully.
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Flow 'volume_create_manager' (a17ff1f1-68b4-43ac-b3b7-4acbc9936841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a5978a-1439-4c70-a7e1-7db90145a3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a5978a-1439-4c70-a7e1-7db90145a3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109109837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe441d6-4f15-4013-8298-9cea32516ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24e90f631e04e04b09c812b70b6c238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:21Z,use_quota=True,user_id='ed1666deb8b343bf83937f00d7d2ec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274f9efb-6351-4692-9ffd-fbf810a6e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274f9efb-6351-4692-9ffd-fbf810a6e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd4b9c8-acd5-40a4-9c37-62b284cac577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd4b9c8-acd5-40a4-9c37-62b284cac577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe441d6-4f15-4013-8298-9cea32516ef6', 'volume_name': 'volume-bbe441d6-4f15-4013-8298-9cea32516ef6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0960ebc1-ed0d-410d-892f-9736ad9139fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0960ebc1-ed0d-410d-892f-9736ad9139fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb5315-437f-487c-9af2-d54fa6309a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Volume bbe441d6-4f15-4013-8298-9cea32516ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe441d6-4f15-4013-8298-9cea32516ef6', 'volume_size': 1}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109109837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe441d6-4f15-4013-8298-9cea32516ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24e90f631e04e04b09c812b70b6c238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:21Z,use_quota=True,user_id='ed1666deb8b343bf83937f00d7d2ec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Creating volume bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:44:21 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:21 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 1073741824
Sep 25 11:44:21 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-14d54769-3727-49b5-8b54-f8d5c8124885-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "cinder-14d54769-3727-49b5-8b54-f8d5c8124885-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-quobyte-14d54769-3727-49b5-8b54-f8d5c8124885" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-14d54769-3727-49b5-8b54-f8d5c8124885" acquired by "delete_volume" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[402a8146-ef00-4fd0-869e-ed486dd79e2f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:22 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885
Sep 25 11:44:22 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:22 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 1073741824" returned: 0 in 1.213s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:22 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:44:22 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:22 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885" returned: 0 in 0.706s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:22 devstack sudo[97768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885
Sep 25 11:44:22 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:23 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb5315-437f-487c-9af2-d54fa6309a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe441d6-4f15-4013-8298-9cea32516ef6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640bf162-c7e4-486c-abd2-4dd17c952bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Volume volume-bbe441d6-4f15-4013-8298-9cea32516ef6 (bbe441d6-4f15-4013-8298-9cea32516ef6): created successfully
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640bf162-c7e4-486c-abd2-4dd17c952bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Flow 'volume_create_manager' (a17ff1f1-68b4-43ac-b3b7-4acbc9936841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4001a705-df62-4a03-8241-05f349b20e88 tempest-VolumesActionsTest-1062329726 None] Created volume successfully.
Sep 25 11:44:23 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-14d54769-3727-49b5-8b54-f8d5c8124885" returned: 0 in 0.583s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-14d54769-3727-49b5-8b54-f8d5c8124885" released by "delete_volume" :: held 1.388s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Created reservations ['167810cd-12ee-453e-9475-d3b7b5726f04', '4dcd456f-2883-44f0-8ee8-8cdf3c0e0174', 'c17c3958-320e-48b4-af7f-38cff1cdfc7c', '4f6640a9-1597-4445-a44c-b6ef7a8fd61a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:23 devstack sudo[97773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:44:23 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:24 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.336s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:24 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:44:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Deleted volume successfully.
Sep 25 11:44:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3667b7c4-3152-450b-a29a-6dd982e8ae6a tempest-VolumesExtendTest-1909651577 None] Lock "cinder-14d54769-3727-49b5-8b54-f8d5c8124885-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:24 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Flow 'volume_create_manager' (51b899c2-73f7-424c-8306-3a0e77dd7386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f8bfb8-07a3-4599-8137-367ab8ba5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f8bfb8-07a3-4599-8137-367ab8ba5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-171772037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2860a542-c617-4ab6-9c64-6ebb50cdbf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ac07403c384a9390116d5cb6cc1b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:25Z,use_quota=True,user_id='d0a3056d9bbe4df6b152c54a409bfd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6164fa9-f201-40b4-8935-cc30c9f9b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6164fa9-f201-40b4-8935-cc30c9f9b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30ddf0-b9e9-4b9e-8f86-ff0ece72e645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30ddf0-b9e9-4b9e-8f86-ff0ece72e645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2860a542-c617-4ab6-9c64-6ebb50cdbf06', 'volume_name': 'volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d970e1a7-4219-4c77-a77c-c5fc3c76d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d970e1a7-4219-4c77-a77c-c5fc3c76d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aa4c87-4ed3-48dc-84f7-23c6cb443714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:25 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Volume 2860a542-c617-4ab6-9c64-6ebb50cdbf06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06', 'volume_size': 1}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-171772037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2860a542-c617-4ab6-9c64-6ebb50cdbf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ac07403c384a9390116d5cb6cc1b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:25Z,use_quota=True,user_id='d0a3056d9bbe4df6b152c54a409bfd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Creating volume 2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:44:25 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:25 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 1073741824
Sep 25 11:44:25 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:25 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 1073741824" returned: 0 in 0.831s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:26 devstack sudo[97826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:26 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:26 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 0.434s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aa4c87-4ed3-48dc-84f7-23c6cb443714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764bc0dd-0725-4e2a-8cf0-3379d02647a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:44:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Volume volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 (2860a542-c617-4ab6-9c64-6ebb50cdbf06): created successfully
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764bc0dd-0725-4e2a-8cf0-3379d02647a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:44:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Flow 'volume_create_manager' (51b899c2-73f7-424c-8306-3a0e77dd7386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:44:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8181828c-b3d8-4f69-b44e-1fdddda34d59 tempest-VolumesExtendTest-1909651577 None] Created volume successfully.
Sep 25 11:44:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Creating offline snapshot 259d4338-091b-4a73-9848-d560285468ba of volume 2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:44:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[05808fb6-d7b0-4e3d-a9da-42bf1f45cc43]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:27 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:27 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:28 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 0.971s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:28 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba 1G
Sep 25 11:44:28 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:29 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba 1G" returned: 0 in 1.085s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:29 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba
Sep 25 11:44:29 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:30 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba" returned: 0 in 0.559s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:30 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba is being set with open permissions: ugo+rw
Sep 25 11:44:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:30 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba
Sep 25 11:44:30 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:30 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba" returned: 0 in 0.380s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:30 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info
Sep 25 11:44:30 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:31 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info" returned: 0 in 0.376s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:31 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info is being set with open permissions: ugo+rw
Sep 25 11:44:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:31 devstack sudo[97962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info
Sep 25 11:44:31 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:31 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.info" returned: 0 in 0.362s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.936s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-32e1e5b8-f87e-4ba9-acde-64fca5f5509a tempest-VolumesExtendTest-1909651577 None] Create snapshot completed successfully
Sep 25 11:44:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:32 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[828168e0-9007-4775-a7b9-f330bb44fa4d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:32 devstack sudo[97968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:32 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:33 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 0.896s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba 2G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba 2G" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.273s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9d1a1a66-40ce-499f-be4f-2ba8a9c83cac tempest-VolumesExtendTest-1909651577 None] Extend volume completed successfully.
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-259d4338-091b-4a73-9848-d560285468ba-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-259d4338-091b-4a73-9848-d560285468ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.131s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-quobyte-259d4338-091b-4a73-9848-d560285468ba" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-259d4338-091b-4a73-9848-d560285468ba" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Deleting offline snapshot 259d4338-091b-4a73-9848-d560285468ba of volume 2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] snapshot_file for this snap is: volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ce27d-c284-4069-9e8e-07da46409211]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:35 devstack sudo[98022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba
Sep 25 11:44:35 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:36 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba" returned: 0 in 1.165s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:44:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe5647-e87f-4c15-959b-5241aab79015]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:37 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:37 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:37 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 1.057s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:37 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba
Sep 25 11:44:37 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:38 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba" returned: 0 in 0.735s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:38 devstack sudo[98097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba
Sep 25 11:44:38 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:39 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06.259d4338-091b-4a73-9848-d560285468ba" returned: 0 in 0.634s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-259d4338-091b-4a73-9848-d560285468ba" released by "_delete_snapshot" :: held 4.027s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" released by "delete_snapshot" :: held 4.087s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:39 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Created reservations ['2545e3cd-b2f8-474d-8d94-3e7a4fa0eada', '9516295f-760c-43a9-8d01-7601c07af1e8', '045bbc7a-5594-4134-a235-5c86de6359a8', '544c1d76-175a-41c7-8f12-6cbc4f441913'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:44:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Delete snapshot completed successfully.
Sep 25 11:44:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eb642f0a-8613-484f-9741-f484ce48af58 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-259d4338-091b-4a73-9848-d560285468ba-delete_snapshot" released by "delete_snapshot" :: held 4.723s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-2860a542-c617-4ab6-9c64-6ebb50cdbf06-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-2860a542-c617-4ab6-9c64-6ebb50cdbf06-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" acquired by "delete_volume" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b155f-68ee-4100-a559-2cef90e36414]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:41 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:41 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c381c1e-8d10-4c67-9a18-e4b2dc743c22 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" by "attach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c381c1e-8d10-4c67-9a18-e4b2dc743c22 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" acquired by "attach_volume" :: waited 0.067s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4c381c1e-8d10-4c67-9a18-e4b2dc743c22 tempest-VolumesActionsTest-1062329726 None] Attaching volume bbe441d6-4f15-4013-8298-9cea32516ef6 to instance 4d5c24d4-b8d8-4efb-99ff-91d4e059c78d at mountpoint /dev/vdb on host None.
Sep 25 11:44:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4c381c1e-8d10-4c67-9a18-e4b2dc743c22 tempest-VolumesActionsTest-1062329726 None] Attach volume completed successfully.
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c381c1e-8d10-4c67-9a18-e4b2dc743c22 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" released by "attach_volume" :: held 0.267s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:42 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 1.193s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:42 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06
Sep 25 11:44:42 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80345e15-0809-4a54-9227-be13488e4f91 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" by "detach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80345e15-0809-4a54-9227-be13488e4f91 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:44:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-80345e15-0809-4a54-9227-be13488e4f91 tempest-VolumesActionsTest-1062329726 None] Detaching volume bbe441d6-4f15-4013-8298-9cea32516ef6 from instance 4d5c24d4-b8d8-4efb-99ff-91d4e059c78d.
Sep 25 11:44:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-80345e15-0809-4a54-9227-be13488e4f91 tempest-VolumesActionsTest-1062329726 None] Detach volume completed successfully.
Sep 25 11:44:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-80345e15-0809-4a54-9227-be13488e4f91 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:43 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2860a542-c617-4ab6-9c64-6ebb50cdbf06" returned: 0 in 0.591s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-quobyte-2860a542-c617-4ab6-9c64-6ebb50cdbf06" released by "delete_volume" :: held 1.941s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Created reservations ['ea87b44a-e15e-484b-afd1-363b73fcc500', '836e7623-f8d9-4cb2-87cb-99bb365df1de', 'dfff1d4f-218a-4856-9c0d-3bca6f5a6319', '2337a5aa-c55c-4476-a90e-f62648a1f452'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:43 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:44:43 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:44 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.678s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:44:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Deleted volume successfully.
Sep 25 11:44:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4b98889a-29a7-45f5-a92e-2067dc73d929 tempest-VolumesExtendTest-1909651577 None] Lock "cinder-2860a542-c617-4ab6-9c64-6ebb50cdbf06-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:44:51 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:44:51 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:44:51 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.476s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:44:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:44:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:44:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:44:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:44:53 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=55,cinder:INSERT=17,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:44:54 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:INSERT=18,cinder:UPDATE=51,cinder:SELECT=51,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:44:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4cc9fcf0-ce66-4e22-962a-39c29efbb7cb req-33f0c8cf-816a-4d73-85b1-54ab0949d324 tempest-TestShelveInstance-1084034660 None] Terminate volume connection completed successfully.
Sep 25 11:44:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4cc9fcf0-ce66-4e22-962a-39c29efbb7cb req-33f0c8cf-816a-4d73-85b1-54ab0949d324 tempest-TestShelveInstance-1084034660 None] Deleting attachment b1bbb831-2098-4ec1-a0fb-a1745ae716ec. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:45:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cf04e216-1b3f-4c26-8980-a34fa0496d4c tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" by "attach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:45:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cf04e216-1b3f-4c26-8980-a34fa0496d4c tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" acquired by "attach_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:45:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cf04e216-1b3f-4c26-8980-a34fa0496d4c tempest-VolumesActionsTest-1062329726 None] Attaching volume bbe441d6-4f15-4013-8298-9cea32516ef6 to instance 63f1ce4d-fd04-409e-943b-9d75a284a438 at mountpoint /dev/vdb on host None.
Sep 25 11:45:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cf04e216-1b3f-4c26-8980-a34fa0496d4c tempest-VolumesActionsTest-1062329726 None] Attach volume completed successfully.
Sep 25 11:45:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cf04e216-1b3f-4c26-8980-a34fa0496d4c tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6" released by "attach_volume" :: held 0.215s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-1eef6b87-fb2a-4bc8-8aba-7a87edc048e1 req-ad9af8fc-afcd-4b4a-85a5-f1a703d91456 tempest-TestShelveInstance-1084034660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-1eef6b87-fb2a-4bc8-8aba-7a87edc048e1 req-ad9af8fc-afcd-4b4a-85a5-f1a703d91456 tempest-TestShelveInstance-1084034660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-1eef6b87-fb2a-4bc8-8aba-7a87edc048e1 req-ad9af8fc-afcd-4b4a-85a5-f1a703d91456 tempest-TestShelveInstance-1084034660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-1eef6b87-fb2a-4bc8-8aba-7a87edc048e1 req-ad9af8fc-afcd-4b4a-85a5-f1a703d91456 tempest-TestShelveInstance-1084034660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-33514946-e011-4792-b2a9-367aa16de541', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '463ccf18-c002-416f-bdcc-c398d05da695', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a19dcc99-6807-4ae1-b312-84c5850a5bcb tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" by "detach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a19dcc99-6807-4ae1-b312-84c5850a5bcb tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:45:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a19dcc99-6807-4ae1-b312-84c5850a5bcb tempest-VolumesActionsTest-1062329726 None] Detaching volume bbe441d6-4f15-4013-8298-9cea32516ef6 from instance 63f1ce4d-fd04-409e-943b-9d75a284a438.
Sep 25 11:45:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-1eef6b87-fb2a-4bc8-8aba-7a87edc048e1 req-ad9af8fc-afcd-4b4a-85a5-f1a703d91456 tempest-TestShelveInstance-1084034660 None] attachment_update completed successfully.
Sep 25 11:45:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a19dcc99-6807-4ae1-b312-84c5850a5bcb tempest-VolumesActionsTest-1062329726 None] Detach volume completed successfully.
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a19dcc99-6807-4ae1-b312-84c5850a5bcb tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Acquiring lock "cinder-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "cinder-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Acquiring lock "cinder-quobyte-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "cinder-quobyte-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e36718-2c6e-47b4-8f93-56bdbf3b04bd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:06 devstack sudo[98373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0
Sep 25 11:45:06 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:06 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" returned: 0 in 0.709s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:06 devstack sudo[98384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0
Sep 25 11:45:06 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:07 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "cinder-quobyte-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0" released by "delete_volume" :: held 1.301s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Created reservations ['ed8cd11c-82eb-4e2a-adc7-01040ebd90e2', '7c30cd6c-2175-4df1-8dac-b13c777de5a0', '1b876379-2f6e-41de-8bce-4cb3a8c5d0e8', '17e00fe4-1704-421a-ad20-9b5d95a8ed3f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:07 devstack sudo[98407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:45:07 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:07 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.309s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:45:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Deleted volume successfully.
Sep 25 11:45:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6ba6d697-dbce-4591-a2a8-6d4fc246e721 tempest-AttachVolumeShelveTestJSON-83704501 None] Lock "cinder-d5b714ff-7dfa-46bd-abd5-0c0419dda3e0-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:45:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[520446dd-7c05-424d-9cda-c281dfb1bbd0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:13 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:45:13 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:13 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.598s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff21e0-7617-46e8-959b-39806c7e0519]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:13 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:45:13 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:14 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.581s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.2ebb024e-b56d-499e-bd90-8a712bb86dc9cs95z6qt.img {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:14 devstack sudo[98425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.2ebb024e-b56d-499e-bd90-8a712bb86dc9cs95z6qt.img
Sep 25 11:45:14 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (fb96616d-4aef-42ec-a4cb-e0a9dda36722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6ba9dc-65ed-496b-a836-f03e96ac05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6ba9dc-65ed-496b-a836-f03e96ac05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1070812949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71612056-9e14-4407-a87d-0136d6c8cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:17Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a739709d-f689-431e-adf4-d698e31a6614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a739709d-f689-431e-adf4-d698e31a6614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e0ff02-4c85-48d0-ac8a-b6cf4d8d3562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e0ff02-4c85-48d0-ac8a-b6cf4d8d3562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71612056-9e14-4407-a87d-0136d6c8cd2f', 'volume_name': 'volume-71612056-9e14-4407-a87d-0136d6c8cd2f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7136eeb5-178c-4984-b7dc-13bcb3a2dec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7136eeb5-178c-4984-b7dc-13bcb3a2dec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b8b361-f39d-4458-b7f4-ba7fb8db39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:16 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Volume 71612056-9e14-4407-a87d-0136d6c8cd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71612056-9e14-4407-a87d-0136d6c8cd2f', 'volume_size': 1}
Sep 25 11:45:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:25 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.2ebb024e-b56d-499e-bd90-8a712bb86dc9cs95z6qt.img" returned: 0 in 11.631s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2ab73-3c48-4ff0-83a3-b09eaa45d071]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:25 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:45:25 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:26 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 1.052s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:26 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:45:26 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6, size 1024.00 MB, duration 11.64 sec, destination /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.2ebb024e-b56d-499e-bd90-8a712bb86dc9cs95z6qt.img {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:45:26 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Converted 1024.00 MB image at 88.01 MB/s
Sep 25 11:45:26 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] 2ebb024e-b56d-499e-bd90-8a712bb86dc9 was raw, no need to convert to raw {{(pid=87358) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 11:45:36 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:51 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:45:51 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:52 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.519s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:45:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:45:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:45:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.772s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Uploaded volume to glance image-id: 2ebb024e-b56d-499e-bd90-8a712bb86dc9. {{(pid=87358) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 39.671s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1070812949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71612056-9e14-4407-a87d-0136d6c8cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:17Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Creating volume 71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:45:56 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:45:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:56 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f 1073741824
Sep 25 11:45:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8cd71634-4d94-4119-9ffd-54965ad828ce tempest-VolumesActionsTest-1062329726 None] Copy volume to image completed successfully.
Sep 25 11:45:56 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:57 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f 1073741824" returned: 0 in 0.962s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:57 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f
Sep 25 11:45:57 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:57 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b8b361-f39d-4458-b7f4-ba7fb8db39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71612056-9e14-4407-a87d-0136d6c8cd2f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74db5230-298f-411e-8f75-f2b39e937fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:45:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Volume volume-71612056-9e14-4407-a87d-0136d6c8cd2f (71612056-9e14-4407-a87d-0136d6c8cd2f): created successfully
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74db5230-298f-411e-8f75-f2b39e937fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:45:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (fb96616d-4aef-42ec-a4cb-e0a9dda36722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:45:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f0f4658e-d033-42c6-a3e5-f3e1525b173c tempest-VolumesSnapshotTestJSON-1192587799 None] Created volume successfully.
Sep 25 11:45:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:45:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:45:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[602521d8-afef-4cb0-a4d2-1e1a97aa33f1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:58 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:45:58 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:59 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Sep 25 11:45:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.689s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:45:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7f002-844d-4ef9-819b-dd4ec7ef1c7e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:45:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:45:59 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:45:59 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:45:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:00 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 1.088s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:00 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img
Sep 25 11:46:00 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-45341889-6422-40bb-899c-2e4a61a90980 tempest-TestShelveInstance-1084034660 None] Terminate volume connection completed successfully.
Sep 25 11:46:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-45341889-6422-40bb-899c-2e4a61a90980 tempest-TestShelveInstance-1084034660 None] Deleting attachment 463ccf18-c002-416f-bdcc-c398d05da695. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:46:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Acquiring lock "cinder-33514946-e011-4792-b2a9-367aa16de541-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "cinder-33514946-e011-4792-b2a9-367aa16de541-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Acquiring lock "cinder-quobyte-33514946-e011-4792-b2a9-367aa16de541" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "cinder-quobyte-33514946-e011-4792-b2a9-367aa16de541" acquired by "delete_volume" :: waited 0.055s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c3f26-49f7-4ff4-8f2a-415a24b181d1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:08 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541
Sep 25 11:46:08 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:09 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541" returned: 0 in 1.101s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:09 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541
Sep 25 11:46:09 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:10 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-33514946-e011-4792-b2a9-367aa16de541" returned: 0 in 0.790s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "cinder-quobyte-33514946-e011-4792-b2a9-367aa16de541" released by "delete_volume" :: held 2.023s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG cinder.quota [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Created reservations ['2c52d7b6-1c99-470f-9d3f-c6fbfbe31ac5', 'cf56c43a-0679-49bb-a09e-16ca79745047', 'f206bfa8-bbc6-4a57-a7cc-0541822f161f', 'e603694d-9cd6-41be-92b0-d8d1935b4911'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:10 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:46:10 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:11 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 1.054s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:11 devstack cinder-volume[87358]: DEBUG cinder.manager [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:46:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Deleted volume successfully.
Sep 25 11:46:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-7f2945df-9756-48a1-9c38-100b5cd8dfa8 req-b3f9b269-653c-448b-b06b-0c579c6a87df tempest-TestShelveInstance-1084034660 None] Lock "cinder-33514946-e011-4792-b2a9-367aa16de541-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:12 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img" returned: 0 in 12.191s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a8562-dba9-4da1-8ac5-e4c9d02d390c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:12 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:46:12 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:12 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.567s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:12 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6, size 1024.00 MB, duration 12.19 sec, destination /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:46:12 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Converted 1024.00 MB image at 83.99 MB/s
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] 6d63a83f-af8a-4cab-ae29-8cb8c355a057 was raw, converting to qcow2 {{(pid=87358) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece922a-2484-469e-a69d-1213ac2a39cc]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:13 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img
Sep 25 11:46:13 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:13 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img" returned: 0 in 0.388s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:13 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img
Sep 25 11:46:13 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:13 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img" returned: 1 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:46:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img /opt/stack/data/cinder/conversion/vol_upload_frr6qrue {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:13 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img /opt/stack/data/cinder/conversion/vol_upload_frr6qrue
Sep 25 11:46:13 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:14 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img /opt/stack/data/cinder/conversion/vol_upload_frr6qrue" returned: 0 in 0.312s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:14 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Image conversion details: src /opt/stack/data/cinder/conversion/bbe441d6-4f15-4013-8298-9cea32516ef6.temp_image.6d63a83f-af8a-4cab-ae29-8cb8c355a057vnraw6p5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_frr6qrue {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:46:14 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 25 11:46:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0069734c-1187-48c4-b8de-ce36ba1d9ae4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_frr6qrue {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:14 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_frr6qrue
Sep 25 11:46:14 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:14 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_frr6qrue" returned: 0 in 0.393s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.079s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Uploaded volume to glance image-id: 6d63a83f-af8a-4cab-ae29-8cb8c355a057. {{(pid=87358) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.673s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Creating offline snapshot 685a9309-7bcc-45d1-9e58-3ffcd80a866f of volume 71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:46:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c334d9ae-94b0-437f-bd7d-533727fc6301 tempest-VolumesActionsTest-1062329726 None] Copy volume to image completed successfully.
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96fd35e-ddf8-4cf3-969c-f513adbed59e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:16 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f
Sep 25 11:46:16 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:16 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f" returned: 0 in 0.446s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:16 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f 1G
Sep 25 11:46:16 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:17 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f 1G" returned: 0 in 0.584s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71612056-9e14-4407-a87d-0136d6c8cd2f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:17 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71612056-9e14-4407-a87d-0136d6c8cd2f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f
Sep 25 11:46:17 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:18 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71612056-9e14-4407-a87d-0136d6c8cd2f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f" returned: 0 in 0.484s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:18 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f is being set with open permissions: ugo+rw
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:18 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f
Sep 25 11:46:18 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "cinder-quobyte-bbe441d6-4f15-4013-8298-9cea32516ef6" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-quobyte-bbe441d6-4f15-4013-8298-9cea32516ef6" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d15a38-6914-471f-a7c0-13d107627e75]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:18 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:18 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:46:18 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:18 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info
Sep 25 11:46:18 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:18 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.625s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:18 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:18 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info is being set with open permissions: ugo+rw
Sep 25 11:46:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:18 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6
Sep 25 11:46:18 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:18 devstack sudo[99298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info
Sep 25 11:46:18 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:19 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-bbe441d6-4f15-4013-8298-9cea32516ef6" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:19 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.info" returned: 0 in 0.305s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.800s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-quobyte-bbe441d6-4f15-4013-8298-9cea32516ef6" released by "delete_volume" :: held 1.041s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-34a346c9-6476-4c5a-913d-d294b1f5a05c tempest-VolumesSnapshotTestJSON-1192587799 None] Create snapshot completed successfully
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Created reservations ['0d1dca9d-23a9-475a-8b3e-2573b07791f1', '950c07c1-be93-4232-a4a7-25fc99c59774', 'ccc1989f-16f7-477f-afc6-2fbac02ec081', '354a6531-02c8-44cc-b337-fec0789f365c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:19 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:46:19 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-685a9309-7bcc-45d1-9e58-3ffcd80a866f-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:19 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-685a9309-7bcc-45d1-9e58-3ffcd80a866f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Deleted volume successfully.
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-25453b42-7dd5-401f-8434-c074f4f5bbd4 tempest-VolumesActionsTest-1062329726 None] Lock "cinder-bbe441d6-4f15-4013-8298-9cea32516ef6-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-685a9309-7bcc-45d1-9e58-3ffcd80a866f" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-685a9309-7bcc-45d1-9e58-3ffcd80a866f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Deleting offline snapshot 685a9309-7bcc-45d1-9e58-3ffcd80a866f of volume 71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] snapshot_file for this snap is: volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c00ca-6432-4225-9bfa-336e02bdd267]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:20 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f
Sep 25 11:46:20 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:20 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71612056-9e14-4407-a87d-0136d6c8cd2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff90b70-d0d1-4055-af89-1fdb3ee52a60]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:20 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f
Sep 25 11:46:20 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:21 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f" returned: 0 in 0.514s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:21 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f
Sep 25 11:46:21 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:21 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f" returned: 0 in 0.532s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:21 devstack sudo[99324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f
Sep 25 11:46:21 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:21 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f.685a9309-7bcc-45d1-9e58-3ffcd80a866f" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-685a9309-7bcc-45d1-9e58-3ffcd80a866f" released by "_delete_snapshot" :: held 2.083s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" released by "delete_snapshot" :: held 2.125s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['66e057eb-aeb7-4135-b9e0-9e5a2839b578', 'cb461b37-e5b9-4036-ad36-a3240aae3806', 'a01481c3-c391-4faf-91e8-f0d8a6566499', '0ad40095-ffea-4110-b67f-61f984a2ef6a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Delete snapshot completed successfully.
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f13e4911-de6b-4ab0-aa16-0df889ebb2bd tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-685a9309-7bcc-45d1-9e58-3ffcd80a866f-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (6dd01618-de96-4cec-9c80-2c9c5cff083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f396cda-a7fe-42fe-87ca-e683484a01ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f396cda-a7fe-42fe-87ca-e683484a01ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-52171583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d49fe6-794e-44ee-8b33-3b8d429271b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:22Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de03228-3e0b-4382-9815-32afc10f179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de03228-3e0b-4382-9815-32afc10f179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9e07d3-3a01-4b8f-9fc7-4e3b6f79ae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9e07d3-3a01-4b8f-9fc7-4e3b6f79ae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d49fe6-794e-44ee-8b33-3b8d429271b9', 'volume_name': 'volume-52d49fe6-794e-44ee-8b33-3b8d429271b9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e916c67-38df-4536-9132-1673627c1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e916c67-38df-4536-9132-1673627c1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c601a9ca-4033-4313-9318-38b53603e19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Volume 52d49fe6-794e-44ee-8b33-3b8d429271b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d49fe6-794e-44ee-8b33-3b8d429271b9', 'volume_size': 1}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-52171583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d49fe6-794e-44ee-8b33-3b8d429271b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:22Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Creating volume 52d49fe6-794e-44ee-8b33-3b8d429271b9 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:22 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:22 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 1073741824
Sep 25 11:46:22 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:23 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 1073741824" returned: 0 in 0.723s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:23 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9
Sep 25 11:46:23 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:23 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9" returned: 0 in 0.472s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c601a9ca-4033-4313-9318-38b53603e19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d49fe6-794e-44ee-8b33-3b8d429271b9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b714fe2d-f6fd-40dd-ac93-d4ac46298d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Volume volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 (52d49fe6-794e-44ee-8b33-3b8d429271b9): created successfully
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b714fe2d-f6fd-40dd-ac93-d4ac46298d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (6dd01618-de96-4cec-9c80-2c9c5cff083b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-49becf5d-ab90-46e2-9c9d-eec69232dc6a tempest-AttachVolumeNegativeTest-1601081074 None] Created volume successfully.
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (89c785db-52fb-4256-9f71-14c085e9907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f9e5fe-2c43-410e-9280-73f09123ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f9e5fe-2c43-410e-9280-73f09123ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-432451849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f9ec67-70e7-4f93-9712-ee1c43be87c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:24Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235a7a09-db63-4e35-a562-abd68bdbaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235a7a09-db63-4e35-a562-abd68bdbaf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5a5cf1-ec49-46ea-a144-7dd325b86bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5a5cf1-ec49-46ea-a144-7dd325b86bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f9ec67-70e7-4f93-9712-ee1c43be87c8', 'volume_name': 'volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b3eed3-63ae-432e-aa64-eb021af3910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b3eed3-63ae-432e-aa64-eb021af3910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59b663f-4647-462a-8c9f-fdd6591e3465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume 94f9ec67-70e7-4f93-9712-ee1c43be87c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8', 'volume_size': 1}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-432451849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f9ec67-70e7-4f93-9712-ee1c43be87c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:24Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating volume 94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:24 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:24 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 1073741824
Sep 25 11:46:24 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:24 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 1073741824" returned: 0 in 0.674s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:25 devstack sudo[99347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:25 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:25 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 0.359s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59b663f-4647-462a-8c9f-fdd6591e3465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e6dcf5-9216-48d9-a2ac-9895e674bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:25 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 (94f9ec67-70e7-4f93-9712-ee1c43be87c8): created successfully
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e6dcf5-9216-48d9-a2ac-9895e674bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (89c785db-52fb-4256-9f71-14c085e9907c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f99bab94-3d27-4dce-9b47-cd705592f334 tempest-VolumesSnapshotTestJSON-1192587799 None] Created volume successfully.
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-090e57e2-1779-4999-a738-ad1c78f7ce64 req-368dbdb4-0ad8-4023-9da7-f9953efe75b0 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-090e57e2-1779-4999-a738-ad1c78f7ce64 req-368dbdb4-0ad8-4023-9da7-f9953efe75b0 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-090e57e2-1779-4999-a738-ad1c78f7ce64 req-368dbdb4-0ad8-4023-9da7-f9953efe75b0 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-090e57e2-1779-4999-a738-ad1c78f7ce64 req-368dbdb4-0ad8-4023-9da7-f9953efe75b0 tempest-AttachVolumeNegativeTest-1601081074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-52d49fe6-794e-44ee-8b33-3b8d429271b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b268f072-2b32-467b-a4ae-faff845f69ef', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:46:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-090e57e2-1779-4999-a738-ad1c78f7ce64 req-368dbdb4-0ad8-4023-9da7-f9953efe75b0 tempest-AttachVolumeNegativeTest-1601081074 None] attachment_update completed successfully.
Sep 25 11:46:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating offline snapshot d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c of volume 94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:46:26 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd851c0-5d17-4c69-aaa9-98dfa709f288]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:26 devstack sudo[99773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:26 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:27 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 0.788s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:27 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c 1G
Sep 25 11:46:27 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:28 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c 1G" returned: 0 in 0.814s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:28 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:28 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:28 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.541s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:28 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c is being set with open permissions: ugo+rw
Sep 25 11:46:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:28 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:28 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:29 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:29 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info
Sep 25 11:46:29 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:29 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info" returned: 0 in 0.447s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:29 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info is being set with open permissions: ugo+rw
Sep 25 11:46:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:29 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info
Sep 25 11:46:29 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:30 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.info" returned: 0 in 0.375s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.537s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e4cc58b5-6e45-4195-a864-8410fb39bd87 tempest-VolumesSnapshotTestJSON-1192587799 None] Create snapshot completed successfully
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (a08db44d-1c3b-4225-8357-be2340e85fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526e69bd-3b5d-49d7-9cc3-749762a4f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526e69bd-3b5d-49d7-9cc3-749762a4f795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1919712274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82703627-d990-4ba5-bb0f-ac4c1c55b90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:32Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a265ff-4714-4842-aabd-8d7583704ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a265ff-4714-4842-aabd-8d7583704ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9182ac-8129-4ca3-8532-473e314fa67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9182ac-8129-4ca3-8532-473e314fa67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82703627-d990-4ba5-bb0f-ac4c1c55b90a', 'volume_name': 'volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a', 'volume_size': 2, 'snapshot_id': 'd7f262bf-48a1-40b4-bfb0-12e8ecf93d0c'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146787b-5f8c-4e91-a47c-0d1b7b653cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146787b-5f8c-4e91-a47c-0d1b7b653cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884bf9c9-b9c1-4499-997e-f72a8d986146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume 82703627-d990-4ba5-bb0f-ac4c1c55b90a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a', 'volume_size': 2, 'snapshot_id': 'd7f262bf-48a1-40b4-bfb0-12e8ecf93d0c'}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-82703627-d990-4ba5-bb0f-ac4c1c55b90a" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-82703627-d990-4ba5-bb0f-ac4c1c55b90a" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating volume 82703627-d990-4ba5-bb0f-ac4c1c55b90a from snapshot d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] snapshot: d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c, volume: 82703627-d990-4ba5-bb0f-ac4c1c55b90a,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[956535eb-cbc1-4841-94e9-79c9286b5614]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:32 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:32 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (bb088971-92eb-4098-aa26-ba565a2e747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245db214-9286-45d3-82cd-8f8116e9d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245db214-9286-45d3-82cd-8f8116e9d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-8445430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9216e7-2172-4194-bfba-fc95d0fa66c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:33Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d971ab98-bafd-461d-abcf-085a988f182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d971ab98-bafd-461d-abcf-085a988f182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd5ac0-cacb-41d3-bef9-ab6a5254abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd5ac0-cacb-41d3-bef9-ab6a5254abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9216e7-2172-4194-bfba-fc95d0fa66c2', 'volume_name': 'volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc55c3e-4b7f-4297-88cb-2fcc1818370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc55c3e-4b7f-4297-88cb-2fcc1818370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f63429-fb16-471d-8e82-9e755d814058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Volume 8f9216e7-2172-4194-bfba-fc95d0fa66c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2', 'volume_size': 1}
Sep 25 11:46:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:33 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.677s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63bdce6-04a2-499e-93bb-25d5d52ad1ef]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:33 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:33 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:33 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 0.565s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:46:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:33 devstack sudo[99815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a
Sep 25 11:46:33 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:43 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a" returned: 0 in 10.121s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:43 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8, size 1024.00 MB, duration 10.12 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:46:43 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Converted 1024.00 MB image at 101.16 MB/s
Sep 25 11:46:43 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a is being set with open permissions: ugo+rw
Sep 25 11:46:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:43 devstack sudo[99861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a
Sep 25 11:46:43 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:44 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" released by "_copy_volume_from_snapshot" :: held 12.001s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-82703627-d990-4ba5-bb0f-ac4c1c55b90a" released by "_create_volume_from_snapshot" :: held 12.147s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.189s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.427s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-8445430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9216e7-2172-4194-bfba-fc95d0fa66c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:33Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Creating volume 8f9216e7-2172-4194-bfba-fc95d0fa66c2 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:44 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:44 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 1073741824
Sep 25 11:46:44 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884bf9c9-b9c1-4499-997e-f72a8d986146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a', 'volume_size': 2, 'snapshot_id': 'd7f262bf-48a1-40b4-bfb0-12e8ecf93d0c'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f180fe-8775-4641-a1ae-0690702a96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:44 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a (82703627-d990-4ba5-bb0f-ac4c1c55b90a): created successfully
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f180fe-8775-4641-a1ae-0690702a96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (a08db44d-1c3b-4225-8357-be2340e85fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b4efe0a4-b728-4160-ad8e-6df12aac09d1 tempest-VolumesSnapshotTestJSON-1192587799 None] Created volume successfully.
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-82703627-d990-4ba5-bb0f-ac4c1c55b90a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-82703627-d990-4ba5-bb0f-ac4c1c55b90a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94d7f6e-b7ac-4635-b61f-fafa97b05a0a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:45 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 1073741824" returned: 0 in 0.984s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:45 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a
Sep 25 11:46:45 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:45 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2
Sep 25 11:46:45 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:45 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2" returned: 0 in 0.491s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:45 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f63429-fb16-471d-8e82-9e755d814058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a10bf7-e5dc-4994-929f-b76c78b937ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a" returned: 0 in 0.774s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:46 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Volume volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 (8f9216e7-2172-4194-bfba-fc95d0fa66c2): created successfully
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a10bf7-e5dc-4994-929f-b76c78b937ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (bb088971-92eb-4098-aa26-ba565a2e747d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:46 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a
Sep 25 11:46:46 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:46 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8fc2c439-9c02-4f38-97c3-5ea0e941f6fa tempest-VolumesListTestJSON-1584009620 None] Created volume successfully.
Sep 25 11:46:46 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-82703627-d990-4ba5-bb0f-ac4c1c55b90a" returned: 0 in 0.437s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-82703627-d990-4ba5-bb0f-ac4c1c55b90a" released by "delete_volume" :: held 1.320s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['0cdac3d2-e3cf-4794-979b-6867b4b83a21', '5c671bcd-934a-4418-8a44-d00f313870b5', '1e8d3ef7-05cd-4740-b495-0c22506f66fb', '95e071d8-f7ef-457b-8342-e87cea7af330'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:46 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:46:46 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:47 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.323s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:46:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Deleted volume successfully.
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=45,cinder:UPDATE=46,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d80cb37-e76a-4c1e-a217-863da4e44d7b tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-82703627-d990-4ba5-bb0f-ac4c1c55b90a-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleting offline snapshot d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c of volume 94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] snapshot_file for this snap is: volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[488dfe8b-cfa9-4359-983c-357077246ec8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:47 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=55,cinder:SELECT=65,cinder:INSERT=8,cinder:DELETE=7 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:46:47 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:47 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (66d3d992-c987-4797-bf0b-547f2fd07d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e1ee23-f192-45c6-ae8b-75c43cc63d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e1ee23-f192-45c6-ae8b-75c43cc63d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1681241514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003bf96d-cf30-460e-877e-941112243296,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:48Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033a80b9-6a98-4c01-ac0a-7763041b9cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033a80b9-6a98-4c01-ac0a-7763041b9cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626f098b-f56b-4798-87cf-e70df06b39bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626f098b-f56b-4798-87cf-e70df06b39bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003bf96d-cf30-460e-877e-941112243296', 'volume_name': 'volume-003bf96d-cf30-460e-877e-941112243296', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2473e1fa-8d2c-493f-962a-8f3fd2346215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2473e1fa-8d2c-493f-962a-8f3fd2346215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08479cb4-906b-47ed-9f25-e30212b3c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Volume 003bf96d-cf30-460e-877e-941112243296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003bf96d-cf30-460e-877e-941112243296', 'volume_size': 1}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1681241514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003bf96d-cf30-460e-877e-941112243296,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:48Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Creating volume 003bf96d-cf30-460e-877e-941112243296 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:48 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:48 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 1073741824
Sep 25 11:46:48 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:48 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.959s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d7c4fd-9c25-4ad0-a2f2-ebdf64067830]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:49 devstack sudo[100010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:49 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:49 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 1073741824" returned: 0 in 0.992s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:49 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296
Sep 25 11:46:49 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:49 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08479cb4-906b-47ed-9f25-e30212b3c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003bf96d-cf30-460e-877e-941112243296', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45cd1c5-d623-46f8-98fe-9ced2576ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:49 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Volume volume-003bf96d-cf30-460e-877e-941112243296 (003bf96d-cf30-460e-877e-941112243296): created successfully
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45cd1c5-d623-46f8-98fe-9ced2576ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (66d3d992-c987-4797-bf0b-547f2fd07d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 1.141s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c6043746-94c6-4e62-be06-95610efde7af tempest-VolumesListTestJSON-1584009620 None] Created volume successfully.
Sep 25 11:46:49 devstack sudo[100023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:49 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:50 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.826s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:50 devstack sudo[100028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c
Sep 25 11:46:50 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:51 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8.d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" returned: 0 in 0.805s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:51 devstack sudo[100031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:46:51 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (41cfefb3-1621-4049-9990-14852bff5d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406d98e-f04d-4a4d-8d2e-d1932144ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c" released by "_delete_snapshot" :: held 4.082s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" released by "delete_snapshot" :: held 4.144s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406d98e-f04d-4a4d-8d2e-d1932144ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533750956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63da933-5cd1-404e-b717-c1d40c9df324,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:51Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d78760-61ca-47f1-9eca-412a7ca9639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d78760-61ca-47f1-9eca-412a7ca9639e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb2f75-4073-4bc8-a170-d2eee6fa56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb2f75-4073-4bc8-a170-d2eee6fa56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63da933-5cd1-404e-b717-c1d40c9df324', 'volume_name': 'volume-a63da933-5cd1-404e-b717-c1d40c9df324', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7cbec-5318-4123-902a-c3c517adcecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7cbec-5318-4123-902a-c3c517adcecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ea94d6-5cbd-485d-94a8-cecc6c910978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Volume a63da933-5cd1-404e-b717-c1d40c9df324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63da933-5cd1-404e-b717-c1d40c9df324', 'volume_size': 1}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533750956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63da933-5cd1-404e-b717-c1d40c9df324,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9c09a4803437f88f55a56d46cadc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:51Z,use_quota=True,user_id='02aa7713448a47d2aa7ec2fa4555384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Creating volume a63da933-5cd1-404e-b717-c1d40c9df324 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:51 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:51 devstack sudo[100034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 1073741824
Sep 25 11:46:51 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:51 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.440s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['08e4d9fe-8e2c-4509-8074-ad1c825636f2', '3fd4c4b2-e78a-431f-8f27-786e1eb714d1', '2a883f95-8bea-4431-adad-ab9c5c123cde', 'd7f0fe8c-1e35-437c-9c2f-776c897bd896'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Delete snapshot completed successfully.
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-08683730-6ed4-4b81-8b6c-1933880cf2f8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-d7f262bf-48a1-40b4-bfb0-12e8ecf93d0c-delete_snapshot" released by "delete_snapshot" :: held 4.806s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:52 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 1073741824" returned: 0 in 0.938s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:52 devstack sudo[100045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324
Sep 25 11:46:52 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-94f9ec67-70e7-4f93-9712-ee1c43be87c8-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-94f9ec67-70e7-4f93-9712-ee1c43be87c8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:53 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324" returned: 0 in 0.552s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5296d-31b9-4ac7-bdc2-a44d9b9142b8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ea94d6-5cbd-485d-94a8-cecc6c910978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63da933-5cd1-404e-b717-c1d40c9df324', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0c278a-c648-4584-a984-f373c82040ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Volume volume-a63da933-5cd1-404e-b717-c1d40c9df324 (a63da933-5cd1-404e-b717-c1d40c9df324): created successfully
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0c278a-c648-4584-a984-f373c82040ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Flow 'volume_create_manager' (41cfefb3-1621-4049-9990-14852bff5d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-64b3dce9-3a4a-4ac0-b7e1-7c15dc417d4b tempest-VolumesListTestJSON-1584009620 None] Created volume successfully.
Sep 25 11:46:53 devstack sudo[100049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:53 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:54 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 0.633s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:54 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8
Sep 25 11:46:54 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:54 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-94f9ec67-70e7-4f93-9712-ee1c43be87c8" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-94f9ec67-70e7-4f93-9712-ee1c43be87c8" released by "delete_volume" :: held 1.205s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['9a469f3a-d0a3-4ce0-b599-6b802165f591', '7a2bff64-ea40-4327-be37-991713493a25', 'e1124841-8d92-4274-9919-dd6575d8e65d', '9c40efee-99b3-458c-8074-e5eeed23eb79'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:54 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:46:54 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:55 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:55 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:46:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleted volume successfully.
Sep 25 11:46:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7bee263a-5c45-48a5-a651-b84f0e503da6 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-94f9ec67-70e7-4f93-9712-ee1c43be87c8-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (5f60a66a-2bab-4e4e-814f-0158dc3fa95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd01d7-5860-4fa2-bc39-72b502e9c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd01d7-5860-4fa2-bc39-72b502e9c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1835825919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0c7ba2-3b64-43e9-bf68-35b593bd0581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:56Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e99b65c-20df-4224-ac7f-cf6be0794489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e99b65c-20df-4224-ac7f-cf6be0794489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d0f847-78d5-4943-bc14-94c2092b1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d0f847-78d5-4943-bc14-94c2092b1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0c7ba2-3b64-43e9-bf68-35b593bd0581', 'volume_name': 'volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db90897-46db-4e3e-9d48-b2db4f427da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db90897-46db-4e3e-9d48-b2db4f427da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed27b215-492f-4748-a701-4a0f1d727941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Volume 5e0c7ba2-3b64-43e9-bf68-35b593bd0581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581', 'volume_size': 1}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1835825919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0c7ba2-3b64-43e9-bf68-35b593bd0581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:56Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Creating volume 5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:46:56 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:46:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:56 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 1073741824
Sep 25 11:46:56 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:57 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 1073741824" returned: 0 in 0.669s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:57 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:46:57 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:57 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 0.406s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed27b215-492f-4748-a701-4a0f1d727941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fca9c-e5e5-47f2-86f5-5f9b94a7d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:46:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Volume volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 (5e0c7ba2-3b64-43e9-bf68-35b593bd0581): created successfully
Sep 25 11:46:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fca9c-e5e5-47f2-86f5-5f9b94a7d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:46:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (5f60a66a-2bab-4e4e-814f-0158dc3fa95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:46:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-72bb9786-1bbc-490e-9908-137286fe44da tempest-VolumesSnapshotTestJSON-1192587799 None] Created volume successfully.
Sep 25 11:46:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-a63da933-5cd1-404e-b717-c1d40c9df324-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-a63da933-5cd1-404e-b717-c1d40c9df324-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-quobyte-a63da933-5cd1-404e-b717-c1d40c9df324" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:46:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-a63da933-5cd1-404e-b717-c1d40c9df324" acquired by "delete_volume" :: waited 0.044s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b912f-d39b-4d88-9c2c-4a44f6f4c3a0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating offline snapshot b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 of volume 5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[65996674-94f5-42ca-b2d1-5d73b3083ee7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:59 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324
Sep 25 11:46:59 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:59 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:46:59 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:59 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324" returned: 0 in 0.535s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:59 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324
Sep 25 11:46:59 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:59 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 0.601s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:46:59 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 1G
Sep 25 11:46:59 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:46:59 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Sep 25 11:46:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a63da933-5cd1-404e-b717-c1d40c9df324" returned: 0 in 0.399s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-a63da933-5cd1-404e-b717-c1d40c9df324" released by "delete_volume" :: held 1.062s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Created reservations ['570b3c9a-3f35-4f8c-8c64-f5aba61806ee', '30a9fa01-f1ab-4190-87d4-b6a1d9ee205e', 'b37047f8-fe94-48fc-85cc-bbe0bea9b56d', '12f2ee13-234c-488f-8ba0-08dd6919f845'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:00 devstack sudo[100089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:00 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:00 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 1G" returned: 0 in 0.797s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:00 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:00 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:00 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.475s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Deleted volume successfully.
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-be96bec8-f41f-4955-8db8-a59a53228c43 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-a63da933-5cd1-404e-b717-c1d40c9df324-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:00 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.416s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:00 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 is being set with open permissions: ugo+rw
Sep 25 11:47:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:01 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:01 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:01 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.400s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-003bf96d-cf30-460e-877e-941112243296-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-003bf96d-cf30-460e-877e-941112243296-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:01 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info
Sep 25 11:47:01 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-quobyte-003bf96d-cf30-460e-877e-941112243296" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-003bf96d-cf30-460e-877e-941112243296" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f1105-1d8d-486c-bd06-7c9e69273210]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:01 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296
Sep 25 11:47:01 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:01 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:01 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info is being set with open permissions: ugo+rw
Sep 25 11:47:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:02 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info
Sep 25 11:47:02 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:02 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296" returned: 0 in 0.761s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:02 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296
Sep 25 11:47:02 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:02 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.info" returned: 0 in 0.620s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.540s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-646fdcfd-bf60-4e96-8c5d-24fc30412911 tempest-VolumesSnapshotTestJSON-1192587799 None] Create snapshot completed successfully
Sep 25 11:47:02 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-003bf96d-cf30-460e-877e-941112243296" returned: 0 in 0.392s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-003bf96d-cf30-460e-877e-941112243296" released by "delete_volume" :: held 1.222s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Created reservations ['07709904-6a41-4c7b-b7e5-d02852656028', 'fa3afa36-992a-4fe7-be86-bcc0e4532400', '940bdc0c-87ea-4dc1-b237-791f16deccdd', 'a0d32e82-270d-466f-8844-1a80c8b890eb'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:03 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:03 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:03 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Deleted volume successfully.
Sep 25 11:47:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-41e87466-fa47-484f-a1b9-4e5eeb8bbfe7 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-003bf96d-cf30-460e-877e-941112243296-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-8f9216e7-2172-4194-bfba-fc95d0fa66c2-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-8f9216e7-2172-4194-bfba-fc95d0fa66c2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "cinder-quobyte-8f9216e7-2172-4194-bfba-fc95d0fa66c2" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-8f9216e7-2172-4194-bfba-fc95d0fa66c2" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b741ec-b242-43e0-9aa0-ddb7b6b7711e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:04 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2
Sep 25 11:47:04 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (6538e114-a989-452c-b87a-89f9d280ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd25496f-7ebd-49e2-aa5c-c1927e47de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd25496f-7ebd-49e2-aa5c-c1927e47de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-568588640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef5e2e6-3079-424a-a17c-7c8162948fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bdcc416d8417a9f2f7a1f5cf10255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:04Z,use_quota=True,user_id='5e5049286e0148168a65acfc51731ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa644417-4fe8-4128-82f1-b798ff699c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa644417-4fe8-4128-82f1-b798ff699c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e3264-97eb-4aff-8b92-02a732d6122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e3264-97eb-4aff-8b92-02a732d6122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ef5e2e6-3079-424a-a17c-7c8162948fb9', 'volume_name': 'volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9', 'volume_size': 1, 'snapshot_id': 'b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20296946-f021-4419-9a4e-29f74f4e23bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20296946-f021-4419-9a4e-29f74f4e23bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c968f3b-1e22-4879-87d9-b390a8234246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume 0ef5e2e6-3079-424a-a17c-7c8162948fb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9', 'volume_size': 1, 'snapshot_id': 'b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62'}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-0ef5e2e6-3079-424a-a17c-7c8162948fb9" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-0ef5e2e6-3079-424a-a17c-7c8162948fb9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating volume 0ef5e2e6-3079-424a-a17c-7c8162948fb9 from snapshot b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] snapshot: b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62, volume: 0ef5e2e6-3079-424a-a17c-7c8162948fb9,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba2fd55-f1bc-4746-9f52-503fdb76cf77]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:04 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2" returned: 0 in 0.558s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:04 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2
Sep 25 11:47:04 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:04 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:04 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:05 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8f9216e7-2172-4194-bfba-fc95d0fa66c2" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-quobyte-8f9216e7-2172-4194-bfba-fc95d0fa66c2" released by "delete_volume" :: held 1.053s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:05 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.512s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb6cda-77b1-4d20-9077-ac1fdcd7e031]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Created reservations ['bd3197a2-a9a5-465d-91d4-693f947c5be4', '02529a7f-8299-4e20-8ce1-3bfe60c35fb8', 'ac25d965-5576-4bea-bfd3-58ba077a6b25', '29ea1230-18ac-4676-961f-6453fd56f4cf'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:05 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:47:05 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:05 devstack sudo[100156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:05 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:05 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:05 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 0.572s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.404s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Deleted volume successfully.
Sep 25 11:47:05 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9
Sep 25 11:47:05 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-811ffbd2-cafe-43a5-8989-10861bdc0898 tempest-VolumesListTestJSON-1584009620 None] Lock "cinder-8f9216e7-2172-4194-bfba-fc95d0fa66c2-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:15 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:INSERT=11,cinder:UPDATE=47,cinder:DELETE=4,cinder:SELECT=29 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:47:15 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=50,cinder:SELECT=44,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:47:16 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9" returned: 0 in 10.108s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581, size 1024.00 MB, duration 10.11 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:47:16 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Converted 1024.00 MB image at 101.25 MB/s
Sep 25 11:47:16 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 is being set with open permissions: ugo+rw
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:16 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9
Sep 25 11:47:16 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:16 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9" returned: 0 in 0.490s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" released by "_copy_volume_from_snapshot" :: held 11.833s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-0ef5e2e6-3079-424a-a17c-7c8162948fb9" released by "_create_volume_from_snapshot" :: held 11.976s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c968f3b-1e22-4879-87d9-b390a8234246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9', 'volume_size': 1, 'snapshot_id': 'b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70e83d8-7230-4570-9219-69170d7cc80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:16 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Volume volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 (0ef5e2e6-3079-424a-a17c-7c8162948fb9): created successfully
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70e83d8-7230-4570-9219-69170d7cc80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Flow 'volume_create_manager' (6538e114-a989-452c-b87a-89f9d280ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b74444f6-c176-42b1-b82c-64b36b7a77f3 tempest-VolumesSnapshotTestJSON-1192587799 None] Created volume successfully.
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-0ef5e2e6-3079-424a-a17c-7c8162948fb9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-0ef5e2e6-3079-424a-a17c-7c8162948fb9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" acquired by "delete_volume" :: waited 0.039s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b9b01-909d-46c0-8e3b-d6f8597cf38b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:17 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9
Sep 25 11:47:17 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:18 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9" returned: 0 in 0.688s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:18 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9
Sep 25 11:47:18 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:18 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0ef5e2e6-3079-424a-a17c-7c8162948fb9" returned: 0 in 0.510s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-0ef5e2e6-3079-424a-a17c-7c8162948fb9" released by "delete_volume" :: held 1.320s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['d42c31f3-4b98-44da-9b5d-ea5638fc37d5', 'c4a74106-2b50-4df9-8b98-272a0f09a308', 'ec86e60d-4511-4864-b567-ef5f46792557', '7d33289a-6144-4831-b706-3eb0248800f4'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Flow 'volume_create_manager' (963af7ef-1730-4079-b3b4-12c41a1b788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f2b938-1a0d-4662-803a-b9a008327266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f2b938-1a0d-4662-803a-b9a008327266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1106091874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03c0921-f31e-445b-8797-7364ffe13f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff364f03b4b4266b77149ea27858494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='c1635a38e2294cf282175e05e9aa68fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5cabf1-4b09-4173-8899-d7ca4f4fa469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5cabf1-4b09-4173-8899-d7ca4f4fa469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d15dde7-1f2b-4be6-81ff-3abe130d9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d15dde7-1f2b-4be6-81ff-3abe130d9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03c0921-f31e-445b-8797-7364ffe13f9f', 'volume_name': 'volume-a03c0921-f31e-445b-8797-7364ffe13f9f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f278cb-fdbd-43af-9e32-b8cb60998b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f278cb-fdbd-43af-9e32-b8cb60998b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88d4433-8eb5-46d4-8a2c-5d995b667e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Volume a03c0921-f31e-445b-8797-7364ffe13f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03c0921-f31e-445b-8797-7364ffe13f9f', 'volume_size': 1}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1106091874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03c0921-f31e-445b-8797-7364ffe13f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff364f03b4b4266b77149ea27858494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='c1635a38e2294cf282175e05e9aa68fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Creating volume a03c0921-f31e-445b-8797-7364ffe13f9f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:47:19 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:19 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f 1073741824
Sep 25 11:47:19 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:19 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:19 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:19 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.525s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleted volume successfully.
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e9991c4-4500-488e-8f7d-a353a0bedc01 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-0ef5e2e6-3079-424a-a17c-7c8162948fb9-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:20 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f 1073741824" returned: 0 in 0.802s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleting offline snapshot b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 of volume 5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] snapshot_file for this snap is: volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a392fa6-6865-4508-981a-cddc552a0015]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:20 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f
Sep 25 11:47:20 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:20 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:20 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:20 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f" returned: 0 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88d4433-8eb5-46d4-8a2c-5d995b667e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03c0921-f31e-445b-8797-7364ffe13f9f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a848bd-e612-420a-b69a-292a1eba9dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Volume volume-a03c0921-f31e-445b-8797-7364ffe13f9f (a03c0921-f31e-445b-8797-7364ffe13f9f): created successfully
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a848bd-e612-420a-b69a-292a1eba9dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Flow 'volume_create_manager' (963af7ef-1730-4079-b3b4-12c41a1b788c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:20 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-184816f7-80b2-4c25-8da3-1097a2f75a41 tempest-VolumesNegativeTest-33491201 None] Created volume successfully.
Sep 25 11:47:20 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.558s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[902465a7-67c0-4194-84fe-e8df57672e0d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:21 devstack sudo[100239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:47:21 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:21 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 1.008s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:21 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:21 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Flow 'volume_create_manager' (95e8d70c-1570-4eb9-bbe8-27b71e3c4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900f4df0-913c-46a8-a7e4-236ddd151110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900f4df0-913c-46a8-a7e4-236ddd151110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1834970424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c41875-f8a8-48cb-a8ba-0869abf9c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813f956d31a7479082f4772322882c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:22Z,use_quota=True,user_id='7dad637b96ba4e45b3f43b4832d9bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be2abc3-27a4-4d17-8844-0afcce8f8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be2abc3-27a4-4d17-8844-0afcce8f8d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33200e3c-6beb-4048-ac91-48cacbfde7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33200e3c-6beb-4048-ac91-48cacbfde7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c41875-f8a8-48cb-a8ba-0869abf9c0f3', 'volume_name': 'volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49f207d-7644-45fb-ab6f-8e73b42d597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49f207d-7644-45fb-ab6f-8e73b42d597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8ed86c-799e-422d-b4bb-b47ea919e9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Volume 75c41875-f8a8-48cb-a8ba-0869abf9c0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3', 'volume_size': 1}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1834970424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c41875-f8a8-48cb-a8ba-0869abf9c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813f956d31a7479082f4772322882c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:22Z,use_quota=True,user_id='7dad637b96ba4e45b3f43b4832d9bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Creating volume 75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:47:22 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:22 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 1073741824
Sep 25 11:47:22 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:22 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.873s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:22 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62
Sep 25 11:47:22 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:23 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581.b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" returned: 0 in 0.619s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62" released by "_delete_snapshot" :: held 3.334s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" released by "delete_snapshot" :: held 3.386s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:23 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 1073741824" returned: 0 in 0.878s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['79b14f60-c492-4b81-9d4b-4e17fefb6011', '58cf3513-c70e-49d9-a264-025ae33f06ab', 'da312205-3eff-4a8f-8be4-2d06a00dfd18', 'b5f7ff75-9f7d-4504-bf8b-1425e347237f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:23 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:47:23 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Delete snapshot completed successfully.
Sep 25 11:47:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57e21a59-05b5-4f05-85d8-7bf90b4d54f0 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-b412b5bb-ff8e-4136-a4ee-2c8fb8d4fd62-delete_snapshot" released by "delete_snapshot" :: held 3.915s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:24 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 0.412s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8ed86c-799e-422d-b4bb-b47ea919e9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fab480-982d-4803-a798-89fd6edf93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:47:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Volume volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 (75c41875-f8a8-48cb-a8ba-0869abf9c0f3): created successfully
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fab480-982d-4803-a798-89fd6edf93f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Flow 'volume_create_manager' (95e8d70c-1570-4eb9-bbe8-27b71e3c4071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:47:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0bfeea74-06a2-4dc4-9181-948c686925d4 tempest-TestStampPattern-353900977 None] Created volume successfully.
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-5e0c7ba2-3b64-43e9-bf68-35b593bd0581-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-5e0c7ba2-3b64-43e9-bf68-35b593bd0581-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" acquired by "delete_volume" :: waited 0.051s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38fb2ed-1586-42c3-80b4-a12e049f7dcc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:25 devstack sudo[100271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:47:25 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-2272751b-1b1f-486c-9226-0059c2cb0e12 req-a8eba172-bec2-46ec-81e3-2bb182c6d7e4 tempest-AttachVolumeNegativeTest-1601081074 None] Terminate volume connection completed successfully.
Sep 25 11:47:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-2272751b-1b1f-486c-9226-0059c2cb0e12 req-a8eba172-bec2-46ec-81e3-2bb182c6d7e4 tempest-AttachVolumeNegativeTest-1601081074 None] Deleting attachment b268f072-2b32-467b-a4ae-faff845f69ef. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:47:25 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 0.720s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:25 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581
Sep 25 11:47:25 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:26 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" returned: 0 in 0.648s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-5e0c7ba2-3b64-43e9-bf68-35b593bd0581" released by "delete_volume" :: held 1.588s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['0e4d614f-d8c7-4de9-b2d1-ebcebde350b7', 'ca0bc274-05dd-42ac-88fb-b9472fbfe57e', '3d92158e-bf5f-4672-9b3c-c39288dedd92', '41b42c91-dd80-40b9-80c0-455dab87dae2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:26 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:26 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:27 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleted volume successfully.
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ed6c3f6e-247c-4621-b72b-edaa5c94e875 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-5e0c7ba2-3b64-43e9-bf68-35b593bd0581-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-71612056-9e14-4407-a87d-0136d6c8cd2f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-71612056-9e14-4407-a87d-0136d6c8cd2f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc07b96-7644-4c8d-b30b-2b54373d7928]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:47:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:27 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f
Sep 25 11:47:27 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:28 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f" returned: 0 in 0.792s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:28 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f
Sep 25 11:47:28 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:28 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-71612056-9e14-4407-a87d-0136d6c8cd2f" returned: 0 in 0.411s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-quobyte-71612056-9e14-4407-a87d-0136d6c8cd2f" released by "delete_volume" :: held 1.341s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Created reservations ['f8f08279-1536-4995-8cd1-96f31a44a1ef', 'bf6191f0-4fdd-4234-adb4-034ab0b72bad', '01d3eb32-d78d-484c-946a-7e977f517313', '0c61a029-0d3c-4810-9f1c-d2a97fbe6704'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:28 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:28 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:29 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:29 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Deleted volume successfully.
Sep 25 11:47:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2c0e1c21-1736-47fe-84dc-67aa942a9cc8 tempest-VolumesSnapshotTestJSON-1192587799 None] Lock "cinder-71612056-9e14-4407-a87d-0136d6c8cd2f-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:47:38 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:47:39 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:INSERT=12,cinder:UPDATE=34,cinder:SELECT=24,cinder:DELETE=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:47:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:47:51 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:47:51 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:47:52 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Sep 25 11:47:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:47:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:47:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:47:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:47:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:48:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Acquiring lock "cinder-a03c0921-f31e-445b-8797-7364ffe13f9f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "cinder-a03c0921-f31e-445b-8797-7364ffe13f9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Acquiring lock "cinder-quobyte-a03c0921-f31e-445b-8797-7364ffe13f9f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "cinder-quobyte-a03c0921-f31e-445b-8797-7364ffe13f9f" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d43e35-d845-4831-aacc-ca08cc47860c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:01 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f
Sep 25 11:48:01 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:01 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f" returned: 0 in 0.592s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:01 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f
Sep 25 11:48:01 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:02 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a03c0921-f31e-445b-8797-7364ffe13f9f" returned: 0 in 0.342s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "cinder-quobyte-a03c0921-f31e-445b-8797-7364ffe13f9f" released by "delete_volume" :: held 1.033s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Created reservations ['779bcdff-09b6-4003-be81-a6b393a1228e', 'af3f525c-2ac8-425d-882f-7818bc5042aa', 'c2851100-0342-486c-a8c4-2b33de5df918', '8e74b2fd-cf03-4962-a2a3-6996ddad2e96'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:02 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:48:02 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:03 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.547s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:03 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:48:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Deleted volume successfully.
Sep 25 11:48:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-611f2616-1220-4546-8988-593527f31466 tempest-VolumesNegativeTest-33491201 None] Lock "cinder-a03c0921-f31e-445b-8797-7364ffe13f9f-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-0b81ce8e-2832-4ce7-8cff-bbd1099b092d req-188c6557-a589-4dfa-b10c-1fe6093e898c tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-0b81ce8e-2832-4ce7-8cff-bbd1099b092d req-188c6557-a589-4dfa-b10c-1fe6093e898c tempest-TestStampPattern-353900977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-0b81ce8e-2832-4ce7-8cff-bbd1099b092d req-188c6557-a589-4dfa-b10c-1fe6093e898c tempest-TestStampPattern-353900977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-0b81ce8e-2832-4ce7-8cff-bbd1099b092d req-188c6557-a589-4dfa-b10c-1fe6093e898c tempest-TestStampPattern-353900977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e1dd412-369d-4760-be75-76a9a613fa90', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:48:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-0b81ce8e-2832-4ce7-8cff-bbd1099b092d req-188c6557-a589-4dfa-b10c-1fe6093e898c tempest-TestStampPattern-353900977 None] attachment_update completed successfully.
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Flow 'volume_create_manager' (55db2a5b-6bc2-4b57-ba91-cd92a2d80d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a544a5-23ae-4995-8c14-a24e1c20b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a544a5-23ae-4995-8c14-a24e1c20b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-675983927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5001e126-f404-449b-9d2a-fe491baf3937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ce6b34b1674641b6503e8af6ac263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:12Z,use_quota=True,user_id='4f482a39f167452b90d2706fc632b34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91af1f2-8423-41a1-9df9-357c86ce55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91af1f2-8423-41a1-9df9-357c86ce55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c5a89-ed12-4c96-af9b-8f199dfa75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c5a89-ed12-4c96-af9b-8f199dfa75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5001e126-f404-449b-9d2a-fe491baf3937', 'volume_name': 'volume-5001e126-f404-449b-9d2a-fe491baf3937', 'volume_size': 2}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1943be9-a24e-4636-9d5a-1833e7bf0cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1943be9-a24e-4636-9d5a-1833e7bf0cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f126edb-2f95-4641-ba33-f7b1166c1ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Volume 5001e126-f404-449b-9d2a-fe491baf3937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5001e126-f404-449b-9d2a-fe491baf3937', 'volume_size': 2}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-675983927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5001e126-f404-449b-9d2a-fe491baf3937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ce6b34b1674641b6503e8af6ac263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:12Z,use_quota=True,user_id='4f482a39f167452b90d2706fc632b34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Creating volume 5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:48:12 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:48:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 2147483648 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:12 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 2147483648
Sep 25 11:48:12 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:13 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 2147483648" returned: 0 in 0.753s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:13 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937
Sep 25 11:48:13 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:13 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937" returned: 0 in 0.331s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f126edb-2f95-4641-ba33-f7b1166c1ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5001e126-f404-449b-9d2a-fe491baf3937', 'volume_size': 2}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c4ecbb-e360-405b-892b-d4d98ec209c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:13 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Volume volume-5001e126-f404-449b-9d2a-fe491baf3937 (5001e126-f404-449b-9d2a-fe491baf3937): created successfully
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c4ecbb-e360-405b-892b-d4d98ec209c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Flow 'volume_create_manager' (55db2a5b-6bc2-4b57-ba91-cd92a2d80d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3cd6912e-b47c-4e77-b097-a325de44a31a tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Created volume successfully.
Sep 25 11:48:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Creating offline snapshot d9db0e6b-ade6-497d-b85d-a7962902f3e9 of volume 5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:48:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4341f-e9e9-42a7-98c8-2697397e367d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:15 devstack sudo[101235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937
Sep 25 11:48:15 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:15 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937" returned: 0 in 0.653s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 2G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:15 devstack sudo[101241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 2G
Sep 25 11:48:15 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:16 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 2G" returned: 0 in 0.682s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5001e126-f404-449b-9d2a-fe491baf3937 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:16 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5001e126-f404-449b-9d2a-fe491baf3937 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9
Sep 25 11:48:16 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-dfa96b60-ca38-4b2a-9c61-9b5ef87d9b20 req-6f707a85-e6fc-4fc5-9015-aaf73089461e tempest-TestStampPattern-353900977 None] Terminate volume connection completed successfully.
Sep 25 11:48:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-dfa96b60-ca38-4b2a-9c61-9b5ef87d9b20 req-6f707a85-e6fc-4fc5-9015-aaf73089461e tempest-TestStampPattern-353900977 None] Deleting attachment 4e1dd412-369d-4760-be75-76a9a613fa90. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:48:17 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5001e126-f404-449b-9d2a-fe491baf3937 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9" returned: 0 in 0.734s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:17 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 is being set with open permissions: ugo+rw
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:17 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9
Sep 25 11:48:17 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:17 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:17 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info
Sep 25 11:48:17 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:17 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info" returned: 0 in 0.333s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:17 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info is being set with open permissions: ugo+rw
Sep 25 11:48:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:17 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info
Sep 25 11:48:17 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:18 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.info" returned: 0 in 0.348s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.383s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0a577f3a-d6b4-4521-ab0b-1cea5a16e753 tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Create snapshot completed successfully
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Creating offline snapshot df7477cc-ee1f-47c7-b228-836bd3d10e34 of volume 75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e8823-ab72-4769-929a-3a2ed0a156a5]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:18 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:48:18 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:19 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 0.517s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:19 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 1G
Sep 25 11:48:19 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "cinder-d9db0e6b-ade6-497d-b85d-a7962902f3e9-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-d9db0e6b-ade6-497d-b85d-a7962902f3e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "cinder-quobyte-d9db0e6b-ade6-497d-b85d-a7962902f3e9" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-d9db0e6b-ade6-497d-b85d-a7962902f3e9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Deleting offline snapshot d9db0e6b-ade6-497d-b85d-a7962902f3e9 of volume 5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] snapshot_file for this snap is: volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e3a02c-fc72-4f59-b226-b48c843097fe]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:19 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9
Sep 25 11:48:19 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:20 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 1G" returned: 0 in 0.807s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:20 devstack sudo[101331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:48:20 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:20 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9" returned: 0 in 0.680s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5001e126-f404-449b-9d2a-fe491baf3937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[233207e3-1912-4109-a064-c1b8bb922dcc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:20 devstack sudo[101336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937
Sep 25 11:48:20 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:20 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.528s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:20 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 is being set with open permissions: ugo+rw
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:20 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:48:20 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:20 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937" returned: 0 in 0.544s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:20 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9
Sep 25 11:48:20 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:20 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:21 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info
Sep 25 11:48:21 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:21 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:21 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info is being set with open permissions: ugo+rw
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:21 devstack sudo[101356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info
Sep 25 11:48:21 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:21 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9" returned: 0 in 0.588s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:21 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9
Sep 25 11:48:21 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:21 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.info" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-903aef10-cce0-411c-8118-2b906985ce9d tempest-TestStampPattern-353900977 None] Create snapshot completed successfully
Sep 25 11:48:21 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937.d9db0e6b-ade6-497d-b85d-a7962902f3e9" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-d9db0e6b-ade6-497d-b85d-a7962902f3e9" released by "_delete_snapshot" :: held 2.386s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" released by "delete_snapshot" :: held 2.426s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Created reservations ['ab0f49f6-911f-4619-8a73-3e060d91f473', '2439cab5-ff91-4d6d-a9e6-81d618889be2', '860045e0-4830-4bc6-acb5-4c85263fd342', '2ef5b2a8-4592-4015-8b50-2a24c9e8df44'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:48:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Delete snapshot completed successfully.
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0f7d34c-a14f-4903-a159-3f857641b86b tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-d9db0e6b-ade6-497d-b85d-a7962902f3e9-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "cinder-5001e126-f404-449b-9d2a-fe491baf3937-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-5001e126-f404-449b-9d2a-fe491baf3937-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba329f8-9d6f-43cf-ac63-35a3eecd71fe]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:23 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937
Sep 25 11:48:23 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:23 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937" returned: 0 in 0.585s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:23 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937
Sep 25 11:48:23 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:23 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5001e126-f404-449b-9d2a-fe491baf3937" returned: 0 in 0.359s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-quobyte-5001e126-f404-449b-9d2a-fe491baf3937" released by "delete_volume" :: held 1.080s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Created reservations ['02630348-5b8c-40ca-bc1f-5884a23aaf5d', '8e6c2881-6749-49be-855a-a95dd954d52f', '7aae95ef-7e3f-4c3c-aa37-8c316d87008d', 'df4f3a50-7de1-40b2-8998-7e8fa617a8e3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:24 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:48:24 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:24 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.364s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:48:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Deleted volume successfully.
Sep 25 11:48:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4169165e-eecb-41fb-93b1-63a16ac79f0f tempest-VolumesSnapshotNegativeTestJSON-1933236112 None] Lock "cinder-5001e126-f404-449b-9d2a-fe491baf3937-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Flow 'volume_create_manager' (6bba302f-07a0-4dfc-bf61-cf0644926432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286f684f-8b31-4762-98fc-d7cccf90e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286f684f-8b31-4762-98fc-d7cccf90e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2064683006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b82f57-aa21-4b61-9c38-cab58625dd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5321e5021b124ff1baceedfa7716563e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:25Z,use_quota=True,user_id='58e937c4aca540a799a0bed99b31a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a6b52-caf8-4598-b107-19adc58946f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a6b52-caf8-4598-b107-19adc58946f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9184b6f9-a8ae-41da-aa7f-00770d6087be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9184b6f9-a8ae-41da-aa7f-00770d6087be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b82f57-aa21-4b61-9c38-cab58625dd5e', 'volume_name': 'volume-29b82f57-aa21-4b61-9c38-cab58625dd5e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620991f7-a19a-471d-8c61-378d1f045d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620991f7-a19a-471d-8c61-378d1f045d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7de25b-078e-476f-9523-227868b7ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:25 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Volume 29b82f57-aa21-4b61-9c38-cab58625dd5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b82f57-aa21-4b61-9c38-cab58625dd5e', 'volume_size': 1}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2064683006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b82f57-aa21-4b61-9c38-cab58625dd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5321e5021b124ff1baceedfa7716563e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:25Z,use_quota=True,user_id='58e937c4aca540a799a0bed99b31a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Creating volume 29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:48:25 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:48:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:25 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e 1073741824
Sep 25 11:48:25 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:26 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e 1073741824" returned: 0 in 0.659s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:26 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:48:26 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:26 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.343s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7de25b-078e-476f-9523-227868b7ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b82f57-aa21-4b61-9c38-cab58625dd5e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa594e-ee6c-482e-9617-ac0314652de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Volume volume-29b82f57-aa21-4b61-9c38-cab58625dd5e (29b82f57-aa21-4b61-9c38-cab58625dd5e): created successfully
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa594e-ee6c-482e-9617-ac0314652de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Flow 'volume_create_manager' (6bba302f-07a0-4dfc-bf61-cf0644926432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-053efd00-b409-4210-a48c-8dd1aedbb1dd tempest-TestImageHashVerification-1339929678 None] Created volume successfully.
Sep 25 11:48:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:28 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f413ca6f-6e5b-47a1-8517-9497642f409f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:28 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:48:28 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:29 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c9687-da10-4150-90b0-b859c29ede22]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:29 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:48:29 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:30 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.809s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e /opt/stack/data/cinder/conversion/29b82f57-aa21-4b61-9c38-cab58625dd5e.temp_image.45ed236a-7110-4549-a56d-da30c59ecb18hv6t98tz.img {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:30 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e /opt/stack/data/cinder/conversion/29b82f57-aa21-4b61-9c38-cab58625dd5e.temp_image.45ed236a-7110-4549-a56d-da30c59ecb18hv6t98tz.img
Sep 25 11:48:30 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (134f4378-66d2-4d13-9908-aa51b23fc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeba603-632f-4338-8166-904a509fbcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeba603-632f-4338-8166-904a509fbcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1475850289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42859ead-f915-44b7-be85-507d166f3579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:30Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2acfda-4325-46f7-b6f8-f69979a7ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2acfda-4325-46f7-b6f8-f69979a7ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc124c9-34ea-4c36-8023-c9379a641bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc124c9-34ea-4c36-8023-c9379a641bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42859ead-f915-44b7-be85-507d166f3579', 'volume_name': 'volume-42859ead-f915-44b7-be85-507d166f3579', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386f3aba-511c-4d3b-94b3-efab2553967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386f3aba-511c-4d3b-94b3-efab2553967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78137012-8ee5-4e80-b79c-74a58edab5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:30 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Volume 42859ead-f915-44b7-be85-507d166f3579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42859ead-f915-44b7-be85-507d166f3579', 'volume_size': 1}
Sep 25 11:48:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Flow 'volume_create_manager' (24a39111-badb-45b1-8f68-42b2e4f192ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463a4842-e0fd-4b82-ab35-6e486f5d871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463a4842-e0fd-4b82-ab35-6e486f5d871b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-474565307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac7910-0009-4d42-8c7c-b60a60f00bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813f956d31a7479082f4772322882c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df7477cc-ee1f-47c7-b228-836bd3d10e34,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:35Z,use_quota=True,user_id='7dad637b96ba4e45b3f43b4832d9bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7eb3ca-bb13-4501-bbf9-ef150f99a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7eb3ca-bb13-4501-bbf9-ef150f99a90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9822a1c7-c9eb-489e-9c77-057ae4992dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9822a1c7-c9eb-489e-9c77-057ae4992dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8ac7910-0009-4d42-8c7c-b60a60f00bb5', 'volume_name': 'volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5', 'volume_size': 1, 'snapshot_id': 'df7477cc-ee1f-47c7-b228-836bd3d10e34'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c7418e-09de-4d49-9e10-b7cdc5483073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c7418e-09de-4d49-9e10-b7cdc5483073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e1ec66-8642-40e8-a886-cb2a0b159fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:48:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Volume f8ac7910-0009-4d42-8c7c-b60a60f00bb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5', 'volume_size': 1, 'snapshot_id': 'df7477cc-ee1f-47c7-b228-836bd3d10e34'}
Sep 25 11:48:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:40 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e /opt/stack/data/cinder/conversion/29b82f57-aa21-4b61-9c38-cab58625dd5e.temp_image.45ed236a-7110-4549-a56d-da30c59ecb18hv6t98tz.img" returned: 0 in 10.125s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545e5e2-73fe-4df9-82d7-12a93b68aac2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:48:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:40 devstack sudo[101468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:48:40 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:41 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.951s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:41 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e, size 1024.00 MB, duration 10.13 sec, destination /opt/stack/data/cinder/conversion/29b82f57-aa21-4b61-9c38-cab58625dd5e.temp_image.45ed236a-7110-4549-a56d-da30c59ecb18hv6t98tz.img {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:48:41 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Converted 1024.00 MB image at 101.12 MB/s
Sep 25 11:48:41 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] 45ed236a-7110-4549-a56d-da30c59ecb18 was raw, no need to convert to raw {{(pid=87358) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=40,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=37,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:48:51 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:48:51 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:48:51 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:48:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:48:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:48:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:48:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 45.539s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Uploaded volume to glance image-id: 45ed236a-7110-4549-a56d-da30c59ecb18. {{(pid=87358) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 43.526s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1475850289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42859ead-f915-44b7-be85-507d166f3579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:30Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Creating volume 42859ead-f915-44b7-be85-507d166f3579 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:14 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:14 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 1073741824
Sep 25 11:49:14 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6bb780cf-c8e4-4aa3-ae9d-bd4330a322dc tempest-TestImageHashVerification-1339929678 None] Copy volume to image completed successfully.
Sep 25 11:49:14 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 1073741824" returned: 0 in 0.556s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:14 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579
Sep 25 11:49:14 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:15 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579" returned: 0 in 0.301s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 39.810s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78137012-8ee5-4e80-b79c-74a58edab5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42859ead-f915-44b7-be85-507d166f3579', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468bed15-bd89-4e4e-882e-9b13903e22c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Creating volume f8ac7910-0009-4d42-8c7c-b60a60f00bb5 from snapshot df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:15 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Volume volume-42859ead-f915-44b7-be85-507d166f3579 (42859ead-f915-44b7-be85-507d166f3579): created successfully
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468bed15-bd89-4e4e-882e-9b13903e22c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (134f4378-66d2-4d13-9908-aa51b23fc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] snapshot: df7477cc-ee1f-47c7-b228-836bd3d10e34, volume: f8ac7910-0009-4d42-8c7c-b60a60f00bb5,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:49:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-66b77888-eff1-497b-8bce-bf5bda437fc7 tempest-AttachVolumeNegativeTest-1601081074 None] Created volume successfully.
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea08e09-f96a-4dd3-a86c-87ba454d396e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:15 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:49:15 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:16 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.618s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[15458611-dae8-4818-865b-a8795074975d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Acquiring lock "cinder-29b82f57-aa21-4b61-9c38-cab58625dd5e-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "cinder-29b82f57-aa21-4b61-9c38-cab58625dd5e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Acquiring lock "cinder-quobyte-29b82f57-aa21-4b61-9c38-cab58625dd5e" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "cinder-quobyte-29b82f57-aa21-4b61-9c38-cab58625dd5e" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[797030eb-fd64-4d86-b46e-6e47915f66c0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:16 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:49:16 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:16 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:49:16 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:16 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 0.698s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:16 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5
Sep 25 11:49:16 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:16 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.623s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:16 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e
Sep 25 11:49:16 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ec07a8b5-31aa-4f7d-97c7-237c196f33b3 req-a6a2a2da-50df-42c1-aaaf-c62cdc1e584e tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:17 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-29b82f57-aa21-4b61-9c38-cab58625dd5e" returned: 0 in 0.407s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "cinder-quobyte-29b82f57-aa21-4b61-9c38-cab58625dd5e" released by "delete_volume" :: held 1.100s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Created reservations ['23d9f72b-9607-4198-a044-7b8b4e90258a', '31f0301a-a753-47cd-aa4d-81cf44d365ab', 'a30ed474-68f1-4365-a6f4-13a80c3d8cc6', 'db5ae6cb-9e3f-4c5b-a6a3-15e1bb9dafcd'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:17 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:49:17 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:18 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.629s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:18 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:49:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Deleted volume successfully.
Sep 25 11:49:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39fa1b27-ebb0-498e-81f6-0ca0f995c720 tempest-TestImageHashVerification-1339929678 None] Lock "cinder-29b82f57-aa21-4b61-9c38-cab58625dd5e-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (ba78e762-1cba-4242-8f01-9537d4bfac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949a2d6c-dc5e-4ec8-b89a-ad2a9743abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949a2d6c-dc5e-4ec8-b89a-ad2a9743abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1063777857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef70194b-d822-4770-a2f1-ec9db72b728c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:19Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(299da3a2-e6af-4343-84b3-e19bae1bf028),volume_type_id=299da3a2-e6af-4343-84b3-e19bae1bf028)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff04406a-5f52-411b-97de-95b3d1c873ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff04406a-5f52-411b-97de-95b3d1c873ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f725098c-ee9f-47c2-91b5-8601f5e96e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f725098c-ee9f-47c2-91b5-8601f5e96e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef70194b-d822-4770-a2f1-ec9db72b728c', 'volume_name': 'volume-ef70194b-d822-4770-a2f1-ec9db72b728c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3aaffa-76d8-4dd3-84dc-f7ee8401472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3aaffa-76d8-4dd3-84dc-f7ee8401472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bad3442-08da-489c-95de-0d87d107d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume ef70194b-d822-4770-a2f1-ec9db72b728c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef70194b-d822-4770-a2f1-ec9db72b728c', 'volume_size': 1}
Sep 25 11:49:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (b35504fa-9ac7-4983-b99e-c15f022b4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6a943-6bb9-44c5-ace7-ba81f1b70502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6a943-6bb9-44c5-ace7-ba81f1b70502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-124142773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf0792a-472c-4b3f-a21d-aaf26c666ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:21Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(570a7f83-55d5-4aeb-a843-fefd7804dd21),volume_type_id=570a7f83-55d5-4aeb-a843-fefd7804dd21)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba2cc6f-9c2b-4bfd-a540-fcbd24fafe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba2cc6f-9c2b-4bfd-a540-fcbd24fafe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b47798-982d-4b96-ba95-9ebb8d75216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b47798-982d-4b96-ba95-9ebb8d75216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf0792a-472c-4b3f-a21d-aaf26c666ef1', 'volume_name': 'volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0b8d23-19e6-47a9-8658-15da2bcc4d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0b8d23-19e6-47a9-8658-15da2bcc4d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81eb432f-becd-489e-9ed4-37a326ec0195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume abf0792a-472c-4b3f-a21d-aaf26c666ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1', 'volume_size': 1}
Sep 25 11:49:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (42a9fafb-5852-42f0-a558-966f03881261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09900c27-37cc-4a44-9437-6aa272724e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09900c27-37cc-4a44-9437-6aa272724e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-124425398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:23Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ef5be8-daf4-404c-8a13-fb387ab67935),volume_type_id=e0ef5be8-daf4-404c-8a13-fb387ab67935)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bfcce9-b573-4f7a-9c9e-f5ab16e7c695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bfcce9-b573-4f7a-9c9e-f5ab16e7c695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad48a27-7158-4a62-b167-729ba08af472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad48a27-7158-4a62-b167-729ba08af472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f', 'volume_name': 'volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f', 'volume_size': 1, 'image_id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1469619677', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bb2778ac30748309678dc0aa5fd8bd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'created_at': datetime.datetime(2026, 9, 25, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 49, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f511972-5739-49a5-80c6-ff03c3e34f72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645e000>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80cfd40-bf4b-4e7c-9399-84aad63deb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80cfd40-bf4b-4e7c-9399-84aad63deb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddef5c9-070c-41ef-8635-1a7e00ab350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f', 'volume_size': 1, 'image_id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1469619677', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bb2778ac30748309678dc0aa5fd8bd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'created_at': datetime.datetime(2026, 9, 25, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 49, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f511972-5739-49a5-80c6-ff03c3e34f72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645e000>}
Sep 25 11:49:23 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Trying to clone 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f from image 9f511972-5739-49a5-80c6-ff03c3e34f72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:49:26 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" returned: 0 in 9.620s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:49:26 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Converted 1024.00 MB image at 106.44 MB/s
Sep 25 11:49:26 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 is being set with open permissions: ugo+rw
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:26 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5
Sep 25 11:49:26 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:26 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" returned: 0 in 0.278s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" released by "_copy_volume_from_snapshot" :: held 11.384s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" released by "_create_volume_from_snapshot" :: held 11.515s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.581s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ec07a8b5-31aa-4f7d-97c7-237c196f33b3 req-a6a2a2da-50df-42c1-aaaf-c62cdc1e584e tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.600s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ec07a8b5-31aa-4f7d-97c7-237c196f33b3 req-a6a2a2da-50df-42c1-aaaf-c62cdc1e584e tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1063777857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef70194b-d822-4770-a2f1-ec9db72b728c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:19Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(299da3a2-e6af-4343-84b3-e19bae1bf028),volume_type_id=299da3a2-e6af-4343-84b3-e19bae1bf028)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Creating volume ef70194b-d822-4770-a2f1-ec9db72b728c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:26 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e1ec66-8642-40e8-a886-cb2a0b159fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5', 'volume_size': 1, 'snapshot_id': 'df7477cc-ee1f-47c7-b228-836bd3d10e34'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c63abf-56e3-473f-a926-8ae7fd1ea099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:26 devstack sudo[101686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c 1073741824
Sep 25 11:49:26 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Volume volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 (f8ac7910-0009-4d42-8c7c-b60a60f00bb5): created successfully
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c63abf-56e3-473f-a926-8ae7fd1ea099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Flow 'volume_create_manager' (24a39111-badb-45b1-8f68-42b2e4f192ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0e36823e-8698-430e-8538-65e4d5af8546 tempest-TestStampPattern-353900977 None] Created volume successfully.
Sep 25 11:49:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-ec07a8b5-31aa-4f7d-97c7-237c196f33b3 req-a6a2a2da-50df-42c1-aaaf-c62cdc1e584e tempest-AttachVolumeNegativeTest-1601081074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-42859ead-f915-44b7-be85-507d166f3579', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '487c0fd1-6a68-485c-8824-b3e5f2c0d494', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:49:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-ec07a8b5-31aa-4f7d-97c7-237c196f33b3 req-a6a2a2da-50df-42c1-aaaf-c62cdc1e584e tempest-AttachVolumeNegativeTest-1601081074 None] attachment_update completed successfully.
Sep 25 11:49:27 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c 1073741824" returned: 0 in 0.783s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:27 devstack sudo[102104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c
Sep 25 11:49:27 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:28 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c" returned: 0 in 0.451s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.846s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-124142773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf0792a-472c-4b3f-a21d-aaf26c666ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:21Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(570a7f83-55d5-4aeb-a843-fefd7804dd21),volume_type_id=570a7f83-55d5-4aeb-a843-fefd7804dd21)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Creating volume abf0792a-472c-4b3f-a21d-aaf26c666ef1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:28 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bad3442-08da-489c-95de-0d87d107d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef70194b-d822-4770-a2f1-ec9db72b728c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215d7270-9a10-424a-ba7e-63bfec8c474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:28 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 1073741824
Sep 25 11:49:28 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume volume-ef70194b-d822-4770-a2f1-ec9db72b728c (ef70194b-d822-4770-a2f1-ec9db72b728c): created successfully
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215d7270-9a10-424a-ba7e-63bfec8c474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (ba78e762-1cba-4242-8f01-9537d4bfac2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f1d2caae-686c-46ff-a528-19aadb544cc1 tempest-TestInstancesWithCinderVolumes-465790441 None] Created volume successfully.
Sep 25 11:49:29 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 1073741824" returned: 0 in 0.938s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:29 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1
Sep 25 11:49:29 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ee38ee24-fa25-455c-9517-dfcc915e7ed2 req-1498c4e3-507e-4268-b7c0-4c2d0d376b09 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:29 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1" returned: 0 in 0.497s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ee38ee24-fa25-455c-9517-dfcc915e7ed2 req-1498c4e3-507e-4268-b7c0-4c2d0d376b09 tempest-TestStampPattern-353900977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.224s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-ee38ee24-fa25-455c-9517-dfcc915e7ed2 req-1498c4e3-507e-4268-b7c0-4c2d0d376b09 tempest-TestStampPattern-353900977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81eb432f-becd-489e-9ed4-37a326ec0195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33a854-a269-4323-ae5c-e8c1505a7f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Volume volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 (abf0792a-472c-4b3f-a21d-aaf26c666ef1): created successfully
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33a854-a269-4323-ae5c-e8c1505a7f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (b35504fa-9ac7-4983-b99e-c15f022b4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-67aafe22-47da-4378-b2f1-8abd13598422 tempest-TestInstancesWithCinderVolumes-465790441 None] Created volume successfully.
Sep 25 11:49:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-ee38ee24-fa25-455c-9517-dfcc915e7ed2 req-1498c4e3-507e-4268-b7c0-4c2d0d376b09 tempest-TestStampPattern-353900977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3072174-db6f-440d-96cc-808549269b13', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:49:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-ee38ee24-fa25-455c-9517-dfcc915e7ed2 req-1498c4e3-507e-4268-b7c0-4c2d0d376b09 tempest-TestStampPattern-353900977 None] attachment_update completed successfully.
Sep 25 11:49:30 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD, size 20.69 MB, duration 7.14 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:49:30 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Image download 20.69 MB at 2.90 MB/s
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbb9ba-9d36-4d57-aa6f-6f062efec395]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-a6f38b32-98c4-48ad-a76f-48101fe43aa0 req-e6cdbfeb-c382-40b8-9c49-a1cd23803387 tempest-AttachVolumeNegativeTest-1601081074 None] Terminate volume connection completed successfully.
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-a6f38b32-98c4-48ad-a76f-48101fe43aa0 req-e6cdbfeb-c382-40b8-9c49-a1cd23803387 tempest-AttachVolumeNegativeTest-1601081074 None] Deleting attachment 487c0fd1-6a68-485c-8824-b3e5f2c0d494. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:49:31 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD
Sep 25 11:49:31 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:31 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Temporary image 9f511972-5739-49a5-80c6-ff03c3e34f72 is fetched for user a717fb2ecae84b4fa39fdc7c6f5afad7. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7148e0ac-438e-4445-985a-f472d6d7e842]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:31 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD
Sep 25 11:49:31 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:32 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-124425398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb2778ac30748309678dc0aa5fd8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:23Z,use_quota=True,user_id='a717fb2ecae84b4fa39fdc7c6f5afad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ef5be8-daf4-404c-8a13-fb387ab67935),volume_type_id=e0ef5be8-daf4-404c-8a13-fb387ab67935)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Creating volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:32 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:32 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1073741824
Sep 25 11:49:32 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:33 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1073741824" returned: 0 in 0.962s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:33 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f
Sep 25 11:49:33 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:33 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" returned: 0 in 0.428s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:33 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Attempting download of 9f511972-5739-49a5-80c6-ff03c3e34f72 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}])) to volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:49:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc76e9a-a6cb-417d-8615-ef5bc7e8dbc5]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_ {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:34 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-b0fd332c-6c7f-4686-a0ef-eb03f50f1a35 req-eede22c7-1ef4-4c37-a0de-61f3b179ed54 tempest-TestStampPattern-353900977 None] Terminate volume connection completed successfully.
Sep 25 11:49:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b0fd332c-6c7f-4686-a0ef-eb03f50f1a35 req-eede22c7-1ef4-4c37-a0de-61f3b179ed54 tempest-TestStampPattern-353900977 None] Deleting attachment f3072174-db6f-440d-96cc-808549269b13. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:49:34 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_
Sep 25 11:49:34 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:34 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_" returned: 0 in 0.531s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_ {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:34 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_
Sep 25 11:49:34 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:35 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_" returned: 1 in 0.509s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f511972-5739-49a5-80c6-ff03c3e34f72_0qfgior_' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe0f5d-6414-43e3-b637-1bec40e0cc74]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:35 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD
Sep 25 11:49:35 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:35 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] 9f511972-5739-49a5-80c6-ff03c3e34f72 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:49:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:35 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f
Sep 25 11:49:35 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:39 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" returned: 0 in 3.867s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9f511972-5739-49a5-80c6-ff03c3e34f72_85c_hlnwdevstack@QuobyteHD, size 112.00 MB, duration 3.87 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:49:39 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Converted 112.00 MB image at 28.95 MB/s
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:39 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1G
Sep 25 11:49:39 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:39 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f 1G" returned: 0 in 0.488s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Downloaded image 9f511972-5739-49a5-80c6-ff03c3e34f72 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}])) to volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Temporary image 9f511972-5739-49a5-80c6-ff03c3e34f72 for user a717fb2ecae84b4fa39fdc7c6f5afad7 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Marking volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Copying metadata from image 9f511972-5739-49a5-80c6-ff03c3e34f72 to 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:49:39 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Creating volume glance metadata for volume 07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f backed by image 9f511972-5739-49a5-80c6-ff03c3e34f72 with: {'image_id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'image_name': 'tempest-scenario-img--1469619677', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:49:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddef5c9-070c-41ef-8635-1a7e00ab350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f', 'volume_size': 1, 'image_id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f511972-5739-49a5-80c6-ff03c3e34f72', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1469619677', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bb2778ac30748309678dc0aa5fd8bd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9f511972-5739-49a5-80c6-ff03c3e34f72', 'created_at': datetime.datetime(2026, 9, 25, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 49, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f511972-5739-49a5-80c6-ff03c3e34f72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d645e000>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b83738-5c04-4e8c-9801-0809eb9279ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:40 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Volume volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f (07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f): created successfully
Sep 25 11:49:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b83738-5c04-4e8c-9801-0809eb9279ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Flow 'volume_create_manager' (42a9fafb-5852-42f0-a558-966f03881261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b9467967-0a7f-4c6d-86f6-e00718139eab tempest-TestInstancesWithCinderVolumes-465790441 None] Created volume successfully.
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-f8ac7910-0009-4d42-8c7c-b60a60f00bb5-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "cinder-f8ac7910-0009-4d42-8c7c-b60a60f00bb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d13ae0-1149-4915-b2a2-81d4c84dc993]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:42 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5
Sep 25 11:49:42 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:42 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" returned: 0 in 0.516s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:42 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5
Sep 25 11:49:42 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:43 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-f8ac7910-0009-4d42-8c7c-b60a60f00bb5" released by "delete_volume" :: held 1.040s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Created reservations ['226d45cc-7ce3-455c-aa37-f00110d1f2a7', '8173e50e-94a8-429b-ac87-f8557343da75', '5e78a145-a216-48e1-a504-2fe52a554447', '61994ffb-215c-444c-a790-7b7cc6f7c9cb'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:43 devstack sudo[102329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:49:43 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:44 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.467s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:49:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Deleted volume successfully.
Sep 25 11:49:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f1d5e31f-68ee-4563-9464-c5f215c6398f tempest-TestStampPattern-353900977 None] Lock "cinder-f8ac7910-0009-4d42-8c7c-b60a60f00bb5-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-df7477cc-ee1f-47c7-b228-836bd3d10e34-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-df7477cc-ee1f-47c7-b228-836bd3d10e34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Deleting offline snapshot df7477cc-ee1f-47c7-b228-836bd3d10e34 of volume 75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] snapshot_file for this snap is: volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2212d36b-b9bc-47e9-ae1d-c586e7debb32]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:45 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:49:45 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (f45dd8ef-66b6-484f-81f3-e6badca21880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a079b5cc-ec57-42f4-bfb1-89a620833c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a079b5cc-ec57-42f4-bfb1-89a620833c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6471158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74b22f6-81aa-4fd0-a92d-ffd345c85bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:46Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ac040a-429d-4b26-99ce-4f40b8eb0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ac040a-429d-4b26-99ce-4f40b8eb0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd34e61-c82b-439f-8657-87733d9eb146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd34e61-c82b-439f-8657-87733d9eb146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74b22f6-81aa-4fd0-a92d-ffd345c85bb4', 'volume_name': 'volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d313ad5-9165-4a08-bae6-6d68e24b1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d313ad5-9165-4a08-bae6-6d68e24b1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa2f29-75fd-4f12-83b5-ac6269e6973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:45 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume d74b22f6-81aa-4fd0-a92d-ffd345c85bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4', 'volume_size': 1}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6471158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74b22f6-81aa-4fd0-a92d-ffd345c85bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:46Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:45 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:45 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 1073741824
Sep 25 11:49:45 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:45 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.650s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab333d-5248-4f0c-920f-7579211cb95c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:46 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:49:46 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5da6cb64-b0e6-4079-86e2-ab63c9bbe5b5 req-b5573525-66fa-4e25-b605-6f360fd5bb7c tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:46 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 1073741824" returned: 0 in 0.969s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:46 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4
Sep 25 11:49:46 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:47 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 1.169s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:47 devstack sudo[102362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:49:47 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:47 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" returned: 0 in 0.543s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5da6cb64-b0e6-4079-86e2-ab63c9bbe5b5 req-b5573525-66fa-4e25-b605-6f360fd5bb7c tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa2f29-75fd-4f12-83b5-ac6269e6973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13b0db5-484c-4aa9-a917-daab767e6120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 (d74b22f6-81aa-4fd0-a92d-ffd345c85bb4): created successfully
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13b0db5-484c-4aa9-a917-daab767e6120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (f45dd8ef-66b6-484f-81f3-e6badca21880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-5da6cb64-b0e6-4079-86e2-ab63c9bbe5b5 req-b5573525-66fa-4e25-b605-6f360fd5bb7c tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2768cace-5f44-4fc5-8d1b-ba6a6511d707 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-5da6cb64-b0e6-4079-86e2-ab63c9bbe5b5 req-b5573525-66fa-4e25-b605-6f360fd5bb7c tempest-TestInstancesWithCinderVolumes-465790441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2ecd74e-2ea8-4ca8-99d4-4b1b9d4de291', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:49:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-5da6cb64-b0e6-4079-86e2-ab63c9bbe5b5 req-b5573525-66fa-4e25-b605-6f360fd5bb7c tempest-TestInstancesWithCinderVolumes-465790441 None] attachment_update completed successfully.
Sep 25 11:49:47 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.700s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:47 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34
Sep 25 11:49:47 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating offline snapshot 54497123-39b6-4f44-9984-26d9ec5b51c5 of volume d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:49:48 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3.df7477cc-ee1f-47c7-b228-836bd3d10e34" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[886f6bdf-86bc-49e1-aa08-96fb363294a1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-df7477cc-ee1f-47c7-b228-836bd3d10e34" released by "_delete_snapshot" :: held 3.231s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" released by "delete_snapshot" :: held 3.294s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:48 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4
Sep 25 11:49:48 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Created reservations ['525637da-76cb-41e7-9586-18eb614472bd', '602f0143-14ee-4951-bda7-b4b11a0a2993', '7f7b5b28-b09c-4d25-a521-011b541ee293', '6d33a4ab-9d76-4374-8d35-ff6fd2f95b31'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:49:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Delete snapshot completed successfully.
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4c3b0c44-3f4a-4bd9-880e-3160c432a4d6 tempest-TestStampPattern-353900977 None] Lock "cinder-df7477cc-ee1f-47c7-b228-836bd3d10e34-delete_snapshot" released by "delete_snapshot" :: held 3.647s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:49:48 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" returned: 0 in 0.547s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:48 devstack sudo[102383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 1G
Sep 25 11:49:48 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:49 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 1G" returned: 0 in 0.686s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:49 devstack sudo[102398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5
Sep 25 11:49:49 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:50 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5" returned: 0 in 0.467s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:50 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 is being set with open permissions: ugo+rw
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:50 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5
Sep 25 11:49:50 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:50 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5" returned: 0 in 0.443s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:50 devstack sudo[102443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info
Sep 25 11:49:50 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:50 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info" returned: 0 in 0.318s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:50 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info is being set with open permissions: ugo+rw
Sep 25 11:49:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:50 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info
Sep 25 11:49:50 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:51 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.info" returned: 0 in 0.306s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.943s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:51 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9ae1bfaa-616a-4977-b505-431841684c86 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Create snapshot completed successfully
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:51 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:49:51 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:51 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:49:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (ee020923-dafc-4cea-97a0-59d92c4a1e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b80f542-56d0-4af3-8361-d048c054f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b80f542-56d0-4af3-8361-d048c054f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129572023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255d7fb5-fe30-41e3-8965-c0a85a29d79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:54Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57c3af-916a-45b9-aa0f-0855ef88e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57c3af-916a-45b9-aa0f-0855ef88e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3d229d-d6dd-4f0f-9909-0490d50ef6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3d229d-d6dd-4f0f-9909-0490d50ef6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255d7fb5-fe30-41e3-8965-c0a85a29d79c', 'volume_name': 'volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd63d6d-3d6e-4493-b1d2-247885abddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd63d6d-3d6e-4493-b1d2-247885abddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0cca18-c258-4325-baaa-73b738a74308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume 255d7fb5-fe30-41e3-8965-c0a85a29d79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c', 'volume_size': 1}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129572023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255d7fb5-fe30-41e3-8965-c0a85a29d79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:54Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume 255d7fb5-fe30-41e3-8965-c0a85a29d79c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:54 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:54 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c 1073741824
Sep 25 11:49:54 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:54 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (f6d87d7e-2829-4cb5-9d5d-93fc1193a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a6c613-eb50-4219-8344-3a662c4ab4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a6c613-eb50-4219-8344-3a662c4ab4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200399151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1df232f-a667-4bf7-8857-842e4d8228cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:55Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7850547-1ae0-4f0a-b526-5949b669b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7850547-1ae0-4f0a-b526-5949b669b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ba36f9-6dfd-42d8-ac73-d37cb70f1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ba36f9-6dfd-42d8-ac73-d37cb70f1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1df232f-a667-4bf7-8857-842e4d8228cf', 'volume_name': 'volume-e1df232f-a667-4bf7-8857-842e4d8228cf', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f12e4f2-43ad-4855-9bc6-9db96f4f743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:55 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f12e4f2-43ad-4855-9bc6-9db96f4f743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7680080e-62b2-42a1-90c5-b369f9d3485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume e1df232f-a667-4bf7-8857-842e4d8228cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1df232f-a667-4bf7-8857-842e4d8228cf', 'volume_size': 1}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c 1073741824" returned: 0 in 1.299s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:55 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c
Sep 25 11:49:55 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (b9f5c615-8792-4697-aeba-7f0310a673af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbee2b5f-643f-4e5b-a994-fc8c7916ab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbee2b5f-643f-4e5b-a994-fc8c7916ab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142446204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88877cb-34e4-466d-9191-8f0f7cf24d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:56Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f01976c-883d-4631-8bc5-f256b0002fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f01976c-883d-4631-8bc5-f256b0002fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e10f5-f939-40b9-927a-940658735a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e10f5-f939-40b9-927a-940658735a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88877cb-34e4-466d-9191-8f0f7cf24d91', 'volume_name': 'volume-c88877cb-34e4-466d-9191-8f0f7cf24d91', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b9ee01-c9a2-4021-bcb9-a2791e89d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b9ee01-c9a2-4021-bcb9-a2791e89d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a44ab58-5864-4f6b-85c3-16c16d479ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume c88877cb-34e4-466d-9191-8f0f7cf24d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88877cb-34e4-466d-9191-8f0f7cf24d91', 'volume_size': 1}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c" returned: 0 in 0.933s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200399151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1df232f-a667-4bf7-8857-842e4d8228cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:55Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume e1df232f-a667-4bf7-8857-842e4d8228cf {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:56 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0cca18-c258-4325-baaa-73b738a74308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf 1073741824
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745ba20-7423-46c4-b69a-997ef89e355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:56 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c (255d7fb5-fe30-41e3-8965-c0a85a29d79c): created successfully
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745ba20-7423-46c4-b69a-997ef89e355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (ee020923-dafc-4cea-97a0-59d92c4a1e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-133eae42-d09a-4492-a9ff-e9e39aaa770a tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (96548e42-e00f-41fe-97ce-6225ce530fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6120500-9ea3-43d2-b20c-98cca5148c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6120500-9ea3-43d2-b20c-98cca5148c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473499932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e786779d-8eb9-455d-87d2-9c73dd5ee690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:57Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05880db1-4ae4-44b2-8409-4f59dce2ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05880db1-4ae4-44b2-8409-4f59dce2ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226a0542-1128-4696-ade9-4e7eb9d2164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226a0542-1128-4696-ade9-4e7eb9d2164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e786779d-8eb9-455d-87d2-9c73dd5ee690', 'volume_name': 'volume-e786779d-8eb9-455d-87d2-9c73dd5ee690', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff0b41-20ff-4ec4-9467-1c209018a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff0b41-20ff-4ec4-9467-1c209018a2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831d249f-5cfe-4930-9129-d4cd659ea605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume e786779d-8eb9-455d-87d2-9c73dd5ee690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e786779d-8eb9-455d-87d2-9c73dd5ee690', 'volume_size': 1}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:57 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf 1073741824" returned: 0 in 1.126s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:57 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf
Sep 25 11:49:57 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:58 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf" returned: 0 in 0.664s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142446204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88877cb-34e4-466d-9191-8f0f7cf24d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:56Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume c88877cb-34e4-466d-9191-8f0f7cf24d91 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:49:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:58 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 1073741824
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7680080e-62b2-42a1-90c5-b369f9d3485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1df232f-a667-4bf7-8857-842e4d8228cf', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0101e519-2bbe-45e8-a8f4-6f3a0f8c59f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (11dd9b14-7d83-4ef9-8b3e-37308f24c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13f6120-8ab6-46f3-8e96-971deec9eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-75c41875-f8a8-48cb-a8ba-0869abf9c0f3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-e1df232f-a667-4bf7-8857-842e4d8228cf (e1df232f-a667-4bf7-8857-842e4d8228cf): created successfully
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0101e519-2bbe-45e8-a8f4-6f3a0f8c59f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (f6d87d7e-2829-4cb5-9d5d-93fc1193a593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13f6120-8ab6-46f3-8e96-971deec9eca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004678500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691d9034-c0f0-427e-b08f-b5b4a87ea713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:58Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a8763-bb68-4fb7-b2ec-4146008c7950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a8763-bb68-4fb7-b2ec-4146008c7950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aa6080-8c50-4926-9412-a2765ceb0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aa6080-8c50-4926-9412-a2765ceb0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691d9034-c0f0-427e-b08f-b5b4a87ea713', 'volume_name': 'volume-691d9034-c0f0-427e-b08f-b5b4a87ea713', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d90669-877f-4992-bc1e-e7a04fade7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d90669-877f-4992-bc1e-e7a04fade7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed6959-768a-4ed6-af3b-db36aae17f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:49:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume 691d9034-c0f0-427e-b08f-b5b4a87ea713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691d9034-c0f0-427e-b08f-b5b4a87ea713', 'volume_size': 1}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "cinder-75c41875-f8a8-48cb-a8ba-0869abf9c0f3-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-da494807-4bd6-448f-8937-09c8d42b181f tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Acquiring lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d2c09-7a57-4e0d-b92c-e40331812152]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:49:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:59 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:49:59 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:59 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 1073741824" returned: 0 in 0.952s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:59 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91
Sep 25 11:49:59 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:49:59 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Sep 25 11:49:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 0.870s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:49:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:49:59 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3
Sep 25 11:49:59 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:00 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91" returned: 0 in 0.762s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473499932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e786779d-8eb9-455d-87d2-9c73dd5ee690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:57Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume e786779d-8eb9-455d-87d2-9c73dd5ee690 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:00 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a44ab58-5864-4f6b-85c3-16c16d479ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88877cb-34e4-466d-9191-8f0f7cf24d91', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:00 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 1073741824
Sep 25 11:50:00 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2743d0e5-6138-4caa-b30d-6647d9f18ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 (c88877cb-34e4-466d-9191-8f0f7cf24d91): created successfully
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2743d0e5-6138-4caa-b30d-6647d9f18ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (b9f5c615-8792-4697-aeba-7f0310a673af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-10c519ad-ff64-48cb-b71d-08279f218d32 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:50:00 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" returned: 0 in 0.981s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "cinder-quobyte-75c41875-f8a8-48cb-a8ba-0869abf9c0f3" released by "delete_volume" :: held 2.039s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Created reservations ['f25e1993-42c6-462c-8b7f-6cea3ebc05bc', 'c826d37c-1208-44f6-8dd0-11d664532ba5', 'ab4cc27e-93b1-4154-b4b6-5097ce5b5f55', 'fb472d1f-1cd8-44ad-a5fd-f5299660e2ef'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:01 devstack sudo[103088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:01 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:01 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 1073741824" returned: 0 in 1.353s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:01 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690
Sep 25 11:50:01 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:01 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.588s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Deleted volume successfully.
Sep 25 11:50:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3315d2bb-fc5d-4ef0-bdfc-e53dddfd0252 tempest-TestStampPattern-353900977 None] Lock "cinder-75c41875-f8a8-48cb-a8ba-0869abf9c0f3-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:02 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690" returned: 0 in 0.649s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.639s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004678500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691d9034-c0f0-427e-b08f-b5b4a87ea713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39156c0b13d4a47823c159109fa9e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:58Z,use_quota=True,user_id='b84114666ae441c488fbc0682d959268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Creating volume 691d9034-c0f0-427e-b08f-b5b4a87ea713 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:02 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831d249f-5cfe-4930-9129-d4cd659ea605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e786779d-8eb9-455d-87d2-9c73dd5ee690', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:02 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 1073741824
Sep 25 11:50:02 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba870f6d-284d-4fc3-a86e-7d6de24b980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:02 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 (e786779d-8eb9-455d-87d2-9c73dd5ee690): created successfully
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba870f6d-284d-4fc3-a86e-7d6de24b980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (96548e42-e00f-41fe-97ce-6225ce530fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ebca5d01-3c8d-4efc-a0c3-0769853e4914 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:50:03 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 1073741824" returned: 0 in 1.353s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:03 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713
Sep 25 11:50:03 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:04 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713" returned: 0 in 0.687s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed6959-768a-4ed6-af3b-db36aae17f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691d9034-c0f0-427e-b08f-b5b4a87ea713', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f26b8b8-ff88-42a4-ab0a-4c4cbe9a40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Volume volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 (691d9034-c0f0-427e-b08f-b5b4a87ea713): created successfully
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f26b8b8-ff88-42a4-ab0a-4c4cbe9a40f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Flow 'volume_create_manager' (11dd9b14-7d83-4ef9-8b3e-37308f24c476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b0224096-a429-4c89-80ed-5fd6efb8ae41 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created volume successfully.
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-691d9034-c0f0-427e-b08f-b5b4a87ea713-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-691d9034-c0f0-427e-b08f-b5b4a87ea713-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-691d9034-c0f0-427e-b08f-b5b4a87ea713" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-691d9034-c0f0-427e-b08f-b5b4a87ea713" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5f758-cd0b-4b0b-8add-cdb97bddb08c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:06 devstack sudo[103107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713
Sep 25 11:50:06 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:06 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713" returned: 0 in 0.906s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:06 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713
Sep 25 11:50:06 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:07 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-691d9034-c0f0-427e-b08f-b5b4a87ea713" returned: 0 in 0.578s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-691d9034-c0f0-427e-b08f-b5b4a87ea713" released by "delete_volume" :: held 1.602s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['67553df3-12ce-49d9-b2d5-b18ae2f4600b', 'a40ee98d-3a53-486f-b06c-88969116dc75', 'c3aa03a4-a1ee-4640-890b-e6e847c87678', '53be5902-193e-4391-b4f9-17cddbea7a1c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:08 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:08 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-e786779d-8eb9-455d-87d2-9c73dd5ee690-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-e786779d-8eb9-455d-87d2-9c73dd5ee690-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-e786779d-8eb9-455d-87d2-9c73dd5ee690" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-e786779d-8eb9-455d-87d2-9c73dd5ee690" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea960a-039e-4703-bc52-bb216e7413fc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:08 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690
Sep 25 11:50:08 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:08 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.869s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec4740de-f925-499d-8e71-37a9dfc91034 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-691d9034-c0f0-427e-b08f-b5b4a87ea713-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:09 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690" returned: 0 in 0.820s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:09 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690
Sep 25 11:50:09 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:09 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e786779d-8eb9-455d-87d2-9c73dd5ee690" returned: 0 in 0.607s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-e786779d-8eb9-455d-87d2-9c73dd5ee690" released by "delete_volume" :: held 1.548s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['ef036cc7-2b8f-48cc-87ed-076a18e62c03', '8995f188-db5b-447c-bd9f-e2695d7b9463', '48791f65-a389-4525-a440-81eee667b659', '9879101b-87c4-4bdd-802b-1fb10683a785'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:10 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:10 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-c88877cb-34e4-466d-9191-8f0f7cf24d91-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-c88877cb-34e4-466d-9191-8f0f7cf24d91-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:10 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.524s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-c88877cb-34e4-466d-9191-8f0f7cf24d91" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ff89fe5e-0d9b-4bde-9920-466bcd4a78c5 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-e786779d-8eb9-455d-87d2-9c73dd5ee690-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-c88877cb-34e4-466d-9191-8f0f7cf24d91" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0694fbf2-d268-4bd8-b75f-69391b3c08ff]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:11 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91
Sep 25 11:50:11 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:11 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91" returned: 0 in 0.975s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:12 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91
Sep 25 11:50:12 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:12 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c88877cb-34e4-466d-9191-8f0f7cf24d91" returned: 0 in 0.572s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-c88877cb-34e4-466d-9191-8f0f7cf24d91" released by "delete_volume" :: held 1.668s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=88,cinder:INSERT=19,cinder:SELECT=73,cinder:DELETE=9 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=96,cinder:UPDATE=84,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['e74c9bea-8111-4d52-829e-ca473f4bef85', '5f6b2ef2-d9fd-4461-9c90-2cb23b19d418', '3c4f9281-2816-4680-9545-01d572e5c31d', '4e8b623d-e422-4dba-aee6-a365e41b2fc6'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:12 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:12 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:13 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.518s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7da392d6-074c-4f1f-a4ed-fc1cefbe3e2b tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-c88877cb-34e4-466d-9191-8f0f7cf24d91-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-e1df232f-a667-4bf7-8857-842e4d8228cf-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-e1df232f-a667-4bf7-8857-842e4d8228cf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-e1df232f-a667-4bf7-8857-842e4d8228cf" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-e1df232f-a667-4bf7-8857-842e4d8228cf" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa696e2-a67d-4797-afd7-0ad49d910f98]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:13 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf
Sep 25 11:50:13 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:14 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf" returned: 0 in 0.746s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:14 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf
Sep 25 11:50:14 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:15 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e1df232f-a667-4bf7-8857-842e4d8228cf" returned: 0 in 0.580s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-e1df232f-a667-4bf7-8857-842e4d8228cf" released by "delete_volume" :: held 1.404s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['5e6e20eb-afe0-4b1d-ace8-bce290c5443a', 'cd5eeb17-4c08-4791-ae79-bf99704dc8dc', 'ec26e07d-d010-4b08-a5fa-8c032e89501b', '9a9ca3f4-854d-4749-9b4a-3b19bd5947e9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:15 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:15 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-255d7fb5-fe30-41e3-8965-c0a85a29d79c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-255d7fb5-fe30-41e3-8965-c0a85a29d79c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:16 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-255d7fb5-fe30-41e3-8965-c0a85a29d79c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.760s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-255d7fb5-fe30-41e3-8965-c0a85a29d79c" acquired by "delete_volume" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e8db7b-21f2-4299-8921-b1e890885b59 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-e1df232f-a667-4bf7-8857-842e4d8228cf-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7359222b-7322-4c2e-bf4c-9a221f21edda]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:16 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c
Sep 25 11:50:16 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:17 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c" returned: 0 in 0.608s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:17 devstack sudo[103214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c
Sep 25 11:50:17 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:17 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-255d7fb5-fe30-41e3-8965-c0a85a29d79c" returned: 0 in 0.753s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-255d7fb5-fe30-41e3-8965-c0a85a29d79c" released by "delete_volume" :: held 1.459s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:17 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['d734c556-2345-4c3a-a0a6-ad746d056f27', '31980ceb-09c3-4217-a8da-3083e1ef3523', '9f9cc0d0-6c36-4da2-9d3c-81d8e6e1b346', 'f3ab7435-f535-4d95-8d13-33785f68c39f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:18 devstack sudo[103218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:18 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:18 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.377s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3f5dc20-e0d1-44ab-be26-cae184daeabc tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-255d7fb5-fe30-41e3-8965-c0a85a29d79c-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-54497123-39b6-4f44-9984-26d9ec5b51c5-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-54497123-39b6-4f44-9984-26d9ec5b51c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-54497123-39b6-4f44-9984-26d9ec5b51c5" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-54497123-39b6-4f44-9984-26d9ec5b51c5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleting offline snapshot 54497123-39b6-4f44-9984-26d9ec5b51c5 of volume d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] snapshot_file for this snap is: volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbad37d-5f40-4f12-b129-70bfd869a2ef]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:18 devstack sudo[103221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5
Sep 25 11:50:18 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:19 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5" returned: 0 in 0.508s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:50:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f4cee2-8f3b-40cb-b17f-27a335d58cd0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:19 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4
Sep 25 11:50:19 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:20 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" returned: 0 in 0.734s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:20 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5
Sep 25 11:50:20 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:20 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5" returned: 0 in 0.614s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:20 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5
Sep 25 11:50:20 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:21 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4.54497123-39b6-4f44-9984-26d9ec5b51c5" returned: 0 in 0.397s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-54497123-39b6-4f44-9984-26d9ec5b51c5" released by "_delete_snapshot" :: held 2.450s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" released by "delete_snapshot" :: held 2.488s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['0ca2cbc8-db60-4956-953d-1437b9b80608', '3157fe3b-9fb1-4709-986e-129276480e01', '82aea1b6-119b-4dc9-8cba-0c7db1807768', '9a66f9dc-b74c-4e40-9174-73d53902f1b1'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Delete snapshot completed successfully.
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a3ccaf09-eeb1-4386-b458-cec175bc9685 tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-54497123-39b6-4f44-9984-26d9ec5b51c5-delete_snapshot" released by "delete_snapshot" :: held 2.738s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a99de1-e505-4a45-861b-0ac82b5af3ef]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:22 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4
Sep 25 11:50:22 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:22 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" returned: 0 in 0.560s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:22 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4
Sep 25 11:50:22 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:22 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-quobyte-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4" released by "delete_volume" :: held 0.980s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Created reservations ['753ecf74-ba3e-4dc5-9fd1-cd7372c59e9c', '6b0491a5-6082-465c-bef1-a7f9afb42892', 'e306c9f2-b7c6-46b2-a2d0-d6d328200ca3', 'c729d5d0-4889-46bc-8d46-8adafd2f1134'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:23 devstack sudo[103256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:23 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:23 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.363s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Deleted volume successfully.
Sep 25 11:50:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb2fbda9-704d-4db2-b8f0-4e5d40a26aae tempest-CreateVolumesFromSnapshotTest-1614230381 None] Lock "cinder-d74b22f6-81aa-4fd0-a92d-ffd345c85bb4-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (1d186cc9-7052-4be2-acb9-c17783cc03f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40695893-7c71-4ad1-b982-48e7e6914aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40695893-7c71-4ad1-b982-48e7e6914aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168697391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debbfdef-d0fa-43eb-90f8-579fcdd44abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:27Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd1e26-4a4c-46fc-9673-94a707e2f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd1e26-4a4c-46fc-9673-94a707e2f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ed4882-f904-4052-964e-c39c62408177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ed4882-f904-4052-964e-c39c62408177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'debbfdef-d0fa-43eb-90f8-579fcdd44abd', 'volume_name': 'volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4c72c-f5a9-4be9-8fa2-128c3302c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4c72c-f5a9-4be9-8fa2-128c3302c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25f948d-7ac4-4217-a04a-517612054446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Volume debbfdef-d0fa-43eb-90f8-579fcdd44abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd', 'volume_size': 1}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168697391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debbfdef-d0fa-43eb-90f8-579fcdd44abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2c9b673324173b8f681d82ed6235d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:27Z,use_quota=True,user_id='eca8c93727ce4b269fd1de01ac74e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Creating volume debbfdef-d0fa-43eb-90f8-579fcdd44abd {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:27 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:27 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd 1073741824
Sep 25 11:50:27 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:28 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd 1073741824" returned: 0 in 0.610s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:28 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd
Sep 25 11:50:28 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:28 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd" returned: 0 in 0.355s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25f948d-7ac4-4217-a04a-517612054446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254fc4fc-0fd8-45f8-b64c-2f6fafbe3c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Volume volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd (debbfdef-d0fa-43eb-90f8-579fcdd44abd): created successfully
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254fc4fc-0fd8-45f8-b64c-2f6fafbe3c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Flow 'volume_create_manager' (1d186cc9-7052-4be2-acb9-c17783cc03f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2ba5ac64-2ede-45ef-9a9b-03ae899248c1 tempest-AttachVolumeNegativeTest-1601081074 None] Created volume successfully.
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (6765e72e-3408-4e8b-bf50-6c22720293c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93603e3b-7564-446b-82f1-4c2fee215d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93603e3b-7564-446b-82f1-4c2fee215d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378564027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51349087-bb6c-423e-9f9d-e6c195f1014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:30Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23afa279-bdca-44cf-a2a9-64621717b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23afa279-bdca-44cf-a2a9-64621717b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3bd1da-c235-47e6-80b9-3947be122566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3bd1da-c235-47e6-80b9-3947be122566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51349087-bb6c-423e-9f9d-e6c195f1014e', 'volume_name': 'volume-51349087-bb6c-423e-9f9d-e6c195f1014e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4804c02d-8400-4216-888a-a7d7f4dadc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4804c02d-8400-4216-888a-a7d7f4dadc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555af743-8c2d-4324-a1be-764662aa3e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume 51349087-bb6c-423e-9f9d-e6c195f1014e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51349087-bb6c-423e-9f9d-e6c195f1014e', 'volume_size': 1}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378564027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51349087-bb6c-423e-9f9d-e6c195f1014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:30Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume 51349087-bb6c-423e-9f9d-e6c195f1014e {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:29 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:29 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e 1073741824
Sep 25 11:50:29 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-46d379d5-8b79-46ad-913b-cfcb5fd70fe7 req-e55dae42-3402-478d-826a-8ee66bf2d534 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:30 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e 1073741824" returned: 0 in 0.728s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:30 devstack sudo[103295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e
Sep 25 11:50:30 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Flow 'volume_create_manager' (e7341cbb-6ca7-4329-bd8b-2711340d6137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef108df-7884-4f79-8aac-c1139442b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef108df-7884-4f79-8aac-c1139442b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430501002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232b277b-1c63-44ca-b2b4-23d0fa7092c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c9bdaaf39411980368094eaedcfb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:31Z,use_quota=True,user_id='f6f4784e16724ea388953444668cfefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4593bb-93a1-4b50-ac39-b1639b63dca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4593bb-93a1-4b50-ac39-b1639b63dca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c352e3-37fe-4cf1-8cd7-07f08ca3e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c352e3-37fe-4cf1-8cd7-07f08ca3e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232b277b-1c63-44ca-b2b4-23d0fa7092c7', 'volume_name': 'volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c686c-2cad-485b-bf4b-cdc036a7f406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c686c-2cad-485b-bf4b-cdc036a7f406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d59bbe-df5c-4feb-b939-aa5486a8addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Volume 232b277b-1c63-44ca-b2b4-23d0fa7092c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7', 'volume_size': 1}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:30 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-46d379d5-8b79-46ad-913b-cfcb5fd70fe7 req-e55dae42-3402-478d-826a-8ee66bf2d534 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.528s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555af743-8c2d-4324-a1be-764662aa3e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51349087-bb6c-423e-9f9d-e6c195f1014e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0130603-8a60-4c06-8a2a-9b5f72c3b161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-46d379d5-8b79-46ad-913b-cfcb5fd70fe7 req-e55dae42-3402-478d-826a-8ee66bf2d534 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430501002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232b277b-1c63-44ca-b2b4-23d0fa7092c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c9bdaaf39411980368094eaedcfb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:31Z,use_quota=True,user_id='f6f4784e16724ea388953444668cfefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Creating volume 232b277b-1c63-44ca-b2b4-23d0fa7092c7 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:31 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:31 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 1073741824
Sep 25 11:50:31 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-51349087-bb6c-423e-9f9d-e6c195f1014e (51349087-bb6c-423e-9f9d-e6c195f1014e): created successfully
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0130603-8a60-4c06-8a2a-9b5f72c3b161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (6765e72e-3408-4e8b-bf50-6c22720293c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b9aac870-094a-4322-a144-662bdd8123e1 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-46d379d5-8b79-46ad-913b-cfcb5fd70fe7 req-e55dae42-3402-478d-826a-8ee66bf2d534 tempest-AttachVolumeNegativeTest-1601081074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8748d173-b7c0-4d87-bc97-ca8755eb3362', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:50:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-46d379d5-8b79-46ad-913b-cfcb5fd70fe7 req-e55dae42-3402-478d-826a-8ee66bf2d534 tempest-AttachVolumeNegativeTest-1601081074 None] attachment_update completed successfully.
Sep 25 11:50:31 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 1073741824" returned: 0 in 0.559s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:31 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7
Sep 25 11:50:31 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:32 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7" returned: 0 in 0.506s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d59bbe-df5c-4feb-b939-aa5486a8addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3b9e28-e75c-40b0-baf7-aa5ce2f5b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Volume volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 (232b277b-1c63-44ca-b2b4-23d0fa7092c7): created successfully
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3b9e28-e75c-40b0-baf7-aa5ce2f5b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Flow 'volume_create_manager' (e7341cbb-6ca7-4329-bd8b-2711340d6137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9c56c8e5-d0a4-49a6-baba-b9008766f7bb tempest-ProjectReaderTests-2009340135 None] Created volume successfully.
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (2ce90c92-469d-41a0-949f-0fd09e0c1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1bea00-dc2e-40d1-843a-14823193981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1bea00-dc2e-40d1-843a-14823193981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247542033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768f969b-227a-477a-995d-595bcc8e7654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:33Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28796032-b466-4562-8dbd-b70705677314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28796032-b466-4562-8dbd-b70705677314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b308bc5-928d-454a-81e4-9637ca1a7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b308bc5-928d-454a-81e4-9637ca1a7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768f969b-227a-477a-995d-595bcc8e7654', 'volume_name': 'volume-768f969b-227a-477a-995d-595bcc8e7654', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b7a737-0869-4415-98a3-c4950ddff5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b7a737-0869-4415-98a3-c4950ddff5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3211f96-2a2b-4451-b293-a03e00db4d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume 768f969b-227a-477a-995d-595bcc8e7654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768f969b-227a-477a-995d-595bcc8e7654', 'volume_size': 1}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247542033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768f969b-227a-477a-995d-595bcc8e7654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:33Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume 768f969b-227a-477a-995d-595bcc8e7654 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:32 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:33 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 1073741824
Sep 25 11:50:33 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "cinder-232b277b-1c63-44ca-b2b4-23d0fa7092c7-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-232b277b-1c63-44ca-b2b4-23d0fa7092c7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "cinder-quobyte-232b277b-1c63-44ca-b2b4-23d0fa7092c7" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (dad41317-374e-4c81-b899-3c58fa20e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f4e799-d64a-4ad9-a9a3-5a8568dc998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-quobyte-232b277b-1c63-44ca-b2b4-23d0fa7092c7" acquired by "delete_volume" :: waited 0.157s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f4e799-d64a-4ad9-a9a3-5a8568dc998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664606093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:34Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff36b2e-e851-4cb9-b785-ebc03c700c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff36b2e-e851-4cb9-b785-ebc03c700c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb69ec56-cf6d-4ca5-96c8-2d15cf163d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb69ec56-cf6d-4ca5-96c8-2d15cf163d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9', 'volume_name': 'volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47afd812-d6f9-44d7-9222-b3caac05df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47afd812-d6f9-44d7-9222-b3caac05df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:34 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a6b77d-1652-4494-a114-bdfb514be9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9', 'volume_size': 1}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f6235e-bb24-44a6-80d1-0f1c57561262]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 1073741824" returned: 0 in 1.149s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:34 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654
Sep 25 11:50:34 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:34 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7
Sep 25 11:50:34 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (71089264-afed-4514-9403-89c0208e7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd26f99e-ad60-4ecb-96e9-e99bfcaf0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654" returned: 0 in 0.614s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664606093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:34Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:34 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd26f99e-ad60-4ecb-96e9-e99bfcaf0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906335726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f3f56f-2188-4382-b79e-9ca632c3566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:35Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:34 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:34 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 1073741824
Sep 25 11:50:34 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d5ebad-c194-41c2-aa0f-d6f1c3f2409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d5ebad-c194-41c2-aa0f-d6f1c3f2409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cd5499-00aa-4e8a-bdc5-f58ebb2143ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cd5499-00aa-4e8a-bdc5-f58ebb2143ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f3f56f-2188-4382-b79e-9ca632c3566f', 'volume_name': 'volume-17f3f56f-2188-4382-b79e-9ca632c3566f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b3665d-8985-4cb4-8f82-90e75465a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b3665d-8985-4cb4-8f82-90e75465a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84fcb6f-172a-49d1-aac4-7702f89dd384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume 17f3f56f-2188-4382-b79e-9ca632c3566f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f3f56f-2188-4382-b79e-9ca632c3566f', 'volume_size': 1}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3211f96-2a2b-4451-b293-a03e00db4d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768f969b-227a-477a-995d-595bcc8e7654', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e72aa6-de4e-40e3-a75d-2aa13a7dd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7" returned: 0 in 1.094s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:35 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7
Sep 25 11:50:35 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-4a8f6acc-11b2-4adb-851e-c664b9f84c2c req-d33d8b6c-94d7-41fb-af53-c9e9ec89ede2 tempest-AttachVolumeNegativeTest-1601081074 None] Terminate volume connection completed successfully.
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-4a8f6acc-11b2-4adb-851e-c664b9f84c2c req-d33d8b6c-94d7-41fb-af53-c9e9ec89ede2 tempest-AttachVolumeNegativeTest-1601081074 None] Deleting attachment 8748d173-b7c0-4d87-bc97-ca8755eb3362. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:50:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-768f969b-227a-477a-995d-595bcc8e7654 (768f969b-227a-477a-995d-595bcc8e7654): created successfully
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e72aa6-de4e-40e3-a75d-2aa13a7dd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (2ce90c92-469d-41a0-949f-0fd09e0c1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (cb08fcc7-44f1-413e-8649-15b919a32686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8a1ae2-5b92-469c-817d-3c3567968004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-289fe137-f600-4413-94a0-0671800a7cd5 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8a1ae2-5b92-469c-817d-3c3567968004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387838429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a2f3d9-bcd1-41a1-add1-21caadb808a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:35Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f50a6e-dc2b-4a9e-83ef-e3ea01a02af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f50a6e-dc2b-4a9e-83ef-e3ea01a02af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83bb567-cd07-4aaa-92f6-0456c9d7ba7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83bb567-cd07-4aaa-92f6-0456c9d7ba7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a2f3d9-bcd1-41a1-add1-21caadb808a9', 'volume_name': 'volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca802b1-8d8a-4c12-9d5f-bc2d13237865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca802b1-8d8a-4c12-9d5f-bc2d13237865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e65f0a-1742-4ffe-ada3-61942119b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume a1a2f3d9-bcd1-41a1-add1-21caadb808a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9', 'volume_size': 1}
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:35 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 1073741824" returned: 0 in 1.110s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:36 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9
Sep 25 11:50:36 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:36 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-232b277b-1c63-44ca-b2b4-23d0fa7092c7" returned: 0 in 1.208s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-quobyte-232b277b-1c63-44ca-b2b4-23d0fa7092c7" released by "delete_volume" :: held 2.488s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (7db6ecbe-a262-4f23-ae41-5e34a4283eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ef6398-d75b-416f-b2eb-8c5e0cecf81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" returned: 0 in 0.482s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906335726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f3f56f-2188-4382-b79e-9ca632c3566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:35Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume 17f3f56f-2188-4382-b79e-9ca632c3566f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:36 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ef6398-d75b-416f-b2eb-8c5e0cecf81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993813734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586ca8f-1181-4c36-9f90-c4619ce7a783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:36Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c75c1fc-321f-4e13-925c-d4aefdcb58cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c75c1fc-321f-4e13-925c-d4aefdcb58cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f 1073741824
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831f7337-d386-4a5a-afe1-339eeb8a9456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831f7337-d386-4a5a-afe1-339eeb8a9456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c586ca8f-1181-4c36-9f90-c4619ce7a783', 'volume_name': 'volume-c586ca8f-1181-4c36-9f90-c4619ce7a783', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997f043-a524-4064-83b0-50a8b146ae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997f043-a524-4064-83b0-50a8b146ae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2cdc70-2609-4085-bd97-b8cf0c7b947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume c586ca8f-1181-4c36-9f90-c4619ce7a783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c586ca8f-1181-4c36-9f90-c4619ce7a783', 'volume_size': 1}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a6b77d-1652-4494-a114-bdfb514be9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c77ba-d2ba-42b7-a4ef-389686fdd44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 (b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9): created successfully
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c77ba-d2ba-42b7-a4ef-389686fdd44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (dad41317-374e-4c81-b899-3c58fa20e725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Created reservations ['1688f114-11ea-496a-a9bc-c3e4a57a3506', '1278098e-c1fd-4d5a-b3cb-c682e97c979b', '5869c6c9-29be-4f6f-8632-5953e338b621', 'c99bbd96-b2cc-4c97-814c-4432e7c07536'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-536c3b77-5d2d-49dc-85ef-a26428022e7c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d5b52a07-0705-42ad-aeaa-caf32e84aa68 req-2469329a-1140-4eef-b2b1-10ba1ffeb159 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:37 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:37 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:37 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Deleted volume successfully.
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-31d440b0-fa75-4e1e-aef5-104f6ce39f22 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-232b277b-1c63-44ca-b2b4-23d0fa7092c7-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:37 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f 1073741824" returned: 0 in 0.864s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:37 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f
Sep 25 11:50:37 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:37 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f" returned: 0 in 0.404s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387838429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a2f3d9-bcd1-41a1-add1-21caadb808a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:35Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume a1a2f3d9-bcd1-41a1-add1-21caadb808a9 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:38 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84fcb6f-172a-49d1-aac4-7702f89dd384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f3f56f-2188-4382-b79e-9ca632c3566f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:38 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 1073741824
Sep 25 11:50:38 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a3f18-be4e-4463-a5ff-968edcf78da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:38 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-17f3f56f-2188-4382-b79e-9ca632c3566f (17f3f56f-2188-4382-b79e-9ca632c3566f): created successfully
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a3f18-be4e-4463-a5ff-968edcf78da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (71089264-afed-4514-9403-89c0208e7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2dbc391a-3071-4865-bb74-2b633bc665df tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:38 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 1073741824" returned: 0 in 0.877s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Flow 'volume_create_manager' (2f0ba63d-3229-46cf-94e2-e1ae3ca60a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96b8679-8f21-4c2a-b313-f958983ebe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96b8679-8f21-4c2a-b313-f958983ebe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992309308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c9bdaaf39411980368094eaedcfb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:39Z,use_quota=True,user_id='f6f4784e16724ea388953444668cfefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d254187-ca54-447b-9437-a34c3adf010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d254187-ca54-447b-9437-a34c3adf010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9f2d24-b815-48ec-9236-476872760019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9f2d24-b815-48ec-9236-476872760019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c', 'volume_name': 'volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41169af3-ede8-4ae3-935d-971d2ac3a9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41169af3-ede8-4ae3-935d-971d2ac3a9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0fac9f-6dd5-4751-af85-3d4fb1823a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:39 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Volume 3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c', 'volume_size': 1}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:39 devstack sudo[103417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9
Sep 25 11:50:39 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:39 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" returned: 0 in 0.345s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.684s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993813734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586ca8f-1181-4c36-9f90-c4619ce7a783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29e9225e2f4a58b6b41d97e41eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:36Z,use_quota=True,user_id='eccd0c9c4a3e4366ae65410ae4e8be3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Creating volume c586ca8f-1181-4c36-9f90-c4619ce7a783 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:39 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e65f0a-1742-4ffe-ada3-61942119b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:39 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 1073741824
Sep 25 11:50:39 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945fd112-f732-4419-9a51-d19a089a11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:39 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 (a1a2f3d9-bcd1-41a1-add1-21caadb808a9): created successfully
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945fd112-f732-4419-9a51-d19a089a11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:39 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (cb08fcc7-44f1-413e-8649-15b919a32686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5e75fee1-4a35-4fcc-ac30-3aa161c7550c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:40 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 1073741824" returned: 0 in 0.638s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:40 devstack sudo[103429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783
Sep 25 11:50:40 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:40 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d5b52a07-0705-42ad-aeaa-caf32e84aa68 req-2469329a-1140-4eef-b2b1-10ba1ffeb159 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.594s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2cdc70-2609-4085-bd97-b8cf0c7b947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c586ca8f-1181-4c36-9f90-c4619ce7a783', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf11cf1-624b-4eff-9059-8d21cf2910c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-d5b52a07-0705-42ad-aeaa-caf32e84aa68 req-2469329a-1140-4eef-b2b1-10ba1ffeb159 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992309308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c9bdaaf39411980368094eaedcfb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:39Z,use_quota=True,user_id='f6f4784e16724ea388953444668cfefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Creating volume 3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:40 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:40 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Volume volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 (c586ca8f-1181-4c36-9f90-c4619ce7a783): created successfully
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf11cf1-624b-4eff-9059-8d21cf2910c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:40 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c 1073741824
Sep 25 11:50:40 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Flow 'volume_create_manager' (7db6ecbe-a262-4f23-ae41-5e34a4283eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4edfd036-427f-438e-b99a-2d6fc7766c89 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created volume successfully.
Sep 25 11:50:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-d5b52a07-0705-42ad-aeaa-caf32e84aa68 req-2469329a-1140-4eef-b2b1-10ba1ffeb159 tempest-TestInstancesWithCinderVolumes-465790441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-ef70194b-d822-4770-a2f1-ec9db72b728c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34717fab-6272-4919-bd29-09b4e5eadd93', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:50:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-d5b52a07-0705-42ad-aeaa-caf32e84aa68 req-2469329a-1140-4eef-b2b1-10ba1ffeb159 tempest-TestInstancesWithCinderVolumes-465790441 None] attachment_update completed successfully.
Sep 25 11:50:41 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c 1073741824" returned: 0 in 0.767s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-c586ca8f-1181-4c36-9f90-c4619ce7a783-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-c586ca8f-1181-4c36-9f90-c4619ce7a783-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:41 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c
Sep 25 11:50:41 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-c586ca8f-1181-4c36-9f90-c4619ce7a783" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-c586ca8f-1181-4c36-9f90-c4619ce7a783" acquired by "delete_volume" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1690370d-36c7-4b09-b2fc-1b8ac5bf709b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:41 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783
Sep 25 11:50:41 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:41 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0fac9f-6dd5-4751-af85-3d4fb1823a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4642ea6-b9d6-4d8d-8bb6-714f1a20e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:41 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Volume volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c (3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c): created successfully
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4642ea6-b9d6-4d8d-8bb6-714f1a20e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Flow 'volume_create_manager' (2f0ba63d-3229-46cf-94e2-e1ae3ca60a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9cb2e57e-060e-4976-8b02-3af2b2d355f7 tempest-ProjectReaderTests-2009340135 None] Created volume successfully.
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-debbfdef-d0fa-43eb-90f8-579fcdd44abd-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-debbfdef-d0fa-43eb-90f8-579fcdd44abd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-quobyte-debbfdef-d0fa-43eb-90f8-579fcdd44abd" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-debbfdef-d0fa-43eb-90f8-579fcdd44abd" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e698d-b6f1-4cca-8740-f9df9670fe30]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783" returned: 0 in 0.564s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783
Sep 25 11:50:42 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "cinder-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:42 devstack sudo[103450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd
Sep 25 11:50:42 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "cinder-quobyte-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-quobyte-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f1667-f7b2-4d4f-b26f-c122bc12321b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c
Sep 25 11:50:42 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:42 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c586ca8f-1181-4c36-9f90-c4619ce7a783" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-c586ca8f-1181-4c36-9f90-c4619ce7a783" released by "delete_volume" :: held 1.038s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['d568b25b-035e-49ca-81b5-b077d94d6ab2', 'c1ddd2f7-e1e6-46b4-ac0e-57cb1292cb33', '62fde2bc-8361-4fc5-9edc-edb33e2d0fc1', '6d6cdcfe-5cbf-4d7a-b65f-838029860bab'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:42 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd" returned: 0 in 0.614s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd
Sep 25 11:50:42 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:42 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:42 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" returned: 0 in 0.564s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:42 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c
Sep 25 11:50:42 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:43 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-debbfdef-d0fa-43eb-90f8-579fcdd44abd" returned: 0 in 0.405s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-debbfdef-d0fa-43eb-90f8-579fcdd44abd" released by "delete_volume" :: held 1.103s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:43 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Created reservations ['bdfa6b97-58d2-4df9-a9b6-e8a31d789012', '19375b66-4a86-4180-a8f4-a5234bf10cb7', '6a65fc4b-eb66-42b5-9d12-a57ec59972c8', 'b4ecefef-9a7f-4f4a-ae50-588a80f0348a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7eb5d83-d01a-4226-8e60-63c3c72176d9 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-c586ca8f-1181-4c36-9f90-c4619ce7a783-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:43 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" returned: 0 in 0.529s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-quobyte-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c" released by "delete_volume" :: held 1.179s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:43 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:43 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Created reservations ['a6564c66-6332-4b6d-bd9f-fceea24b1610', '81fe90ad-da93-4b53-8f57-b15b34eb3484', '829793cd-5d67-4308-8a53-03106061c274', 'eb6342fc-1a8c-4fdb-be59-d0422a7bc99d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-42859ead-f915-44b7-be85-507d166f3579-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-a1a2f3d9-bcd1-41a1-add1-21caadb808a9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-42859ead-f915-44b7-be85-507d166f3579-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-a1a2f3d9-bcd1-41a1-add1-21caadb808a9-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-quobyte-42859ead-f915-44b7-be85-507d166f3579" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:43 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:43 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-42859ead-f915-44b7-be85-507d166f3579" acquired by "delete_volume" :: waited 0.086s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" acquired by "delete_volume" :: waited 0.069s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:43 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3c4cfa-8de0-43f0-a254-8e8e7a6e9691]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ba6f3-3d41-436f-8018-90f1a908c1e9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-9a9043a2-623e-4166-9de7-788363315acf req-b4c89943-6d2e-4b4f-b6ef-2248f7352c64 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-9a9043a2-623e-4166-9de7-788363315acf req-b4c89943-6d2e-4b4f-b6ef-2248f7352c64 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Deleted volume successfully.
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-9a9043a2-623e-4166-9de7-788363315acf req-b4c89943-6d2e-4b4f-b6ef-2248f7352c64 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aa541270-e836-43ac-8504-1ec56ad81b65 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-debbfdef-d0fa-43eb-90f8-579fcdd44abd-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-9a9043a2-623e-4166-9de7-788363315acf req-b4c89943-6d2e-4b4f-b6ef-2248f7352c64 tempest-TestInstancesWithCinderVolumes-465790441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d072b0a-dd52-4d01-a0c6-279bd94e0288', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:50:44 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9
Sep 25 11:50:44 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:44 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579
Sep 25 11:50:44 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-9a9043a2-623e-4166-9de7-788363315acf req-b4c89943-6d2e-4b4f-b6ef-2248f7352c64 tempest-TestInstancesWithCinderVolumes-465790441 None] attachment_update completed successfully.
Sep 25 11:50:44 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Deleted volume successfully.
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8584fee0-84cc-4311-9f5e-0c99217adaf3 tempest-ProjectReaderTests-2009340135 None] Lock "cinder-3b8c747d-5a4d-47aa-9c40-cce75a9bbd8c-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:44 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" returned: 0 in 0.532s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:44 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579" returned: 0 in 0.579s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:44 devstack sudo[103509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9
Sep 25 11:50:44 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:44 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579
Sep 25 11:50:44 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:44 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-42859ead-f915-44b7-be85-507d166f3579" returned: 0 in 0.404s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-42859ead-f915-44b7-be85-507d166f3579" released by "delete_volume" :: held 1.058s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:45 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" returned: 0 in 0.486s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-a1a2f3d9-bcd1-41a1-add1-21caadb808a9" released by "delete_volume" :: held 1.087s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Created reservations ['09b48c03-9ab0-4963-95a6-87e2498decf6', '359c44c3-1635-4f7b-a04b-f7dc69ffbee7', '2868fc64-e6e1-4225-b9e6-a4aa4000d44b', '5fd3c79d-2b59-4215-b4ff-5670ce25fc7b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['40937bbe-2b10-44fa-8f86-2f6b716b7cd9', '3dea5327-b757-4f6a-bce7-fe49a2a29e20', '2e6cc36e-df21-40cb-9f15-b028db876a23', '5b0d56f9-a5d8-4dbc-be8a-40e6692ce6ee'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:45 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:45 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:45 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:45 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:45 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Deleted volume successfully.
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb49439c-cab3-4f34-9c70-48b564d462a6 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-42859ead-f915-44b7-be85-507d166f3579-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:45 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e904a385-db23-4898-8898-d979b56a98ce tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-a1a2f3d9-bcd1-41a1-add1-21caadb808a9-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-17f3f56f-2188-4382-b79e-9ca632c3566f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-17f3f56f-2188-4382-b79e-9ca632c3566f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-17f3f56f-2188-4382-b79e-9ca632c3566f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-17f3f56f-2188-4382-b79e-9ca632c3566f" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d589f-ef34-47bb-843f-403b483d2131]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-52d49fe6-794e-44ee-8b33-3b8d429271b9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-52d49fe6-794e-44ee-8b33-3b8d429271b9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "cinder-quobyte-52d49fe6-794e-44ee-8b33-3b8d429271b9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:46 devstack sudo[103531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f
Sep 25 11:50:46 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-52d49fe6-794e-44ee-8b33-3b8d429271b9" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cbce98-8ad5-47c0-9f8e-72f5491ae4d0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:46 devstack sudo[103533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9
Sep 25 11:50:46 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:47 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f" returned: 0 in 0.667s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:47 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f
Sep 25 11:50:47 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:47 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9" returned: 0 in 0.541s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:47 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9
Sep 25 11:50:47 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:47 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-17f3f56f-2188-4382-b79e-9ca632c3566f" returned: 0 in 0.399s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-17f3f56f-2188-4382-b79e-9ca632c3566f" released by "delete_volume" :: held 1.144s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['f37ef506-c696-4383-b276-167a1257f937', '50bbcc71-55fb-4ebc-a3c8-89cf88e69e54', '5d783f69-711b-494c-8b23-b51d108fc46c', '1215b2fe-181a-4856-8416-fab39399f9ab'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:47 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-52d49fe6-794e-44ee-8b33-3b8d429271b9" returned: 0 in 0.437s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-quobyte-52d49fe6-794e-44ee-8b33-3b8d429271b9" released by "delete_volume" :: held 1.062s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Created reservations ['3f414ef3-2721-49ba-831d-322d86e6630d', '87beeb1a-3007-403b-99e6-1898cc26d8f0', '73e165ce-75aa-4518-b362-103e6dc62cfc', 'aaff5be8-2daf-4126-9ca3-f3f7c0c2d78a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:47 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:47 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:47 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:48 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:48 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.341s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c772e38a-602c-4b71-a815-1c8916073759 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-17f3f56f-2188-4382-b79e-9ca632c3566f-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:48 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.351s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Deleted volume successfully.
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0745c541-ffff-41d6-a396-b1051b2d6cd2 tempest-AttachVolumeNegativeTest-1601081074 None] Lock "cinder-52d49fe6-794e-44ee-8b33-3b8d429271b9-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173a718-bb84-4271-bf12-b383f22a87e0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:48 devstack sudo[103554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9
Sep 25 11:50:48 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:49 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" returned: 0 in 0.515s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:49 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9
Sep 25 11:50:49 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:49 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9" released by "delete_volume" :: held 0.905s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['8e4226de-1d22-49c6-84e3-f713e917507d', 'c96203ca-eb91-4f7f-a2d2-7c7783582786', '49b9e1ba-b944-415b-9ede-d0057dd39103', '5510644e-987a-4daa-a625-9d4fbd3fdc9c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:49 devstack sudo[103582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:49 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-768f969b-227a-477a-995d-595bcc8e7654-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-768f969b-227a-477a-995d-595bcc8e7654-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-768f969b-227a-477a-995d-595bcc8e7654" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-768f969b-227a-477a-995d-595bcc8e7654" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f8f9e-814b-4d4a-846b-057cee9fb307]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:50 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654
Sep 25 11:50:50 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:50 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.572s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5d6400c8-602c-4682-9482-2b415bcbfd1a tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-b32b9d9b-136f-4dbc-8c3d-52f670cb2bf9-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:50 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654" returned: 0 in 0.748s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:50 devstack sudo[103630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654
Sep 25 11:50:50 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:51 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-768f969b-227a-477a-995d-595bcc8e7654" returned: 0 in 0.455s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-768f969b-227a-477a-995d-595bcc8e7654" released by "delete_volume" :: held 1.284s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['8e004176-0007-4bda-95f9-08ea999c386d', '088f8869-e346-4d2a-ae2b-7eecb47fa0bf', 'bb18ef9f-bbf4-43cf-902d-34b58ecf71f0', '60b5eb87-74be-4796-bbe0-8d5576fc8f65'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:51 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-ae4bc84d-eb62-4a5c-80a0-9bb2d585ae75 req-cb979726-2f4a-4b1d-98c1-a8ee22bbfc8d tempest-TestInstancesWithCinderVolumes-465790441 None] Terminate volume connection completed successfully.
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-ae4bc84d-eb62-4a5c-80a0-9bb2d585ae75 req-cb979726-2f4a-4b1d-98c1-a8ee22bbfc8d tempest-TestInstancesWithCinderVolumes-465790441 None] Deleting attachment 34717fab-6272-4919-bd29-09b4e5eadd93. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:51 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:51 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:51 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:51 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:51 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:50:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:50:52 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-ef70194b-d822-4770-a2f1-ec9db72b728c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.543s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-ef70194b-d822-4770-a2f1-ec9db72b728c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-82c92df8-1010-4265-8677-001a499d02c4 tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-768f969b-227a-477a-995d-595bcc8e7654-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-quobyte-ef70194b-d822-4770-a2f1-ec9db72b728c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-ef70194b-d822-4770-a2f1-ec9db72b728c" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede793b3-ba45-4600-a1ad-a9e6501cfe2c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-51349087-bb6c-423e-9f9d-e6c195f1014e-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-51349087-bb6c-423e-9f9d-e6c195f1014e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "cinder-quobyte-51349087-bb6c-423e-9f9d-e6c195f1014e" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:52 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c
Sep 25 11:50:52 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-51349087-bb6c-423e-9f9d-e6c195f1014e" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5283167-f9a9-48f0-80d8-93f2498f4299]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:52 devstack sudo[103653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e
Sep 25 11:50:52 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:52 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c" returned: 0 in 0.498s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:52 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c
Sep 25 11:50:52 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:53 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e" returned: 0 in 0.587s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:53 devstack sudo[103664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e
Sep 25 11:50:53 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:53 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ef70194b-d822-4770-a2f1-ec9db72b728c" returned: 0 in 0.498s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-ef70194b-d822-4770-a2f1-ec9db72b728c" released by "delete_volume" :: held 1.086s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:53 devstack cinder-volume[87358]: WARNING cinder.quota [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7158163-524125851 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7158163-524125851, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:50:53 devstack cinder-volume[87358]: WARNING cinder.quota [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7158163-524125851 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7158163-524125851, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Created reservations ['7d1545ed-2819-4751-b765-5d93c8ab356d', 'faeb496c-a94d-403f-ae82-5fd228cbe52d', '631677f6-11f4-4f61-8263-6c89000ff9b7', '5c4fa464-d8aa-42a4-b7c9-90a9f107cf81'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:53 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:53 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:53 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51349087-bb6c-423e-9f9d-e6c195f1014e" returned: 0 in 0.583s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-quobyte-51349087-bb6c-423e-9f9d-e6c195f1014e" released by "delete_volume" :: held 1.240s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Created reservations ['ab065063-dbd9-4789-89c3-5313ef93297e', 'b2392a88-7540-4ba6-a6cd-600236e54898', '9837abd7-cdb8-4eab-b46b-5ee46ed0709e', '5fce6b01-de4d-4c1c-ae3f-5b2f84622ddc'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:53 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.397s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:53 devstack sudo[103671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Deleted volume successfully.
Sep 25 11:50:53 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-42535f8f-608d-49fe-9d9f-b1cb964896ac tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-ef70194b-d822-4770-a2f1-ec9db72b728c-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:54 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.365s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:54 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:50:54 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Deleted volume successfully.
Sep 25 11:50:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a5939cbd-13fe-47e7-8993-ca04dca32d5c tempest-CreateVolumesFromSourceVolumeTest-1792694620 None] Lock "cinder-51349087-bb6c-423e-9f9d-e6c195f1014e-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-465d7ceb-6751-4b44-a705-495a431f087e req-22041bc2-729f-4e5d-ba53-d859612f577b tempest-TestInstancesWithCinderVolumes-465790441 None] Terminate volume connection completed successfully.
Sep 25 11:50:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-465d7ceb-6751-4b44-a705-495a431f087e req-22041bc2-729f-4e5d-ba53-d859612f577b tempest-TestInstancesWithCinderVolumes-465790441 None] Deleting attachment 3d072b0a-dd52-4d01-a0c6-279bd94e0288. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-abf0792a-472c-4b3f-a21d-aaf26c666ef1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-abf0792a-472c-4b3f-a21d-aaf26c666ef1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-quobyte-abf0792a-472c-4b3f-a21d-aaf26c666ef1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-abf0792a-472c-4b3f-a21d-aaf26c666ef1" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda8b8b-c4c6-4809-84c5-03955d1b7d75]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:58 devstack sudo[103703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1
Sep 25 11:50:58 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:58 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1" returned: 0 in 0.550s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:58 devstack sudo[103709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1
Sep 25 11:50:58 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:59 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-abf0792a-472c-4b3f-a21d-aaf26c666ef1" returned: 0 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-abf0792a-472c-4b3f-a21d-aaf26c666ef1" released by "delete_volume" :: held 1.014s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:50:59 devstack cinder-volume[87358]: WARNING cinder.quota [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177926870-1484844045 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177926870-1484844045, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:50:59 devstack cinder-volume[87358]: WARNING cinder.quota [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177926870-1484844045 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177926870-1484844045, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Created reservations ['bb32cc2f-dea7-4af6-bfb5-b6985f899482', '431aadf3-5363-4968-837e-0dfd9537aa19', '914864e7-aaca-4ced-a128-268b101acf23', '5ebfa3e5-66c4-4024-b94d-bfedd63e31da'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Flow 'volume_create_manager' (b9223c96-85da-4e58-b062-89ae966884a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7b29a-71b5-49a5-bc0b-4314626e2a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7b29a-71b5-49a5-bc0b-4314626e2a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-294186236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c40b64-fc60-4477-9874-ceeadf5ff809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddc08b5601e462db5458ab56e78b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:59Z,use_quota=True,user_id='68a32adf27564bdaa55e31de9ac18a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f731e6a2-769e-4f23-808d-0d0409ce991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f731e6a2-769e-4f23-808d-0d0409ce991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f853e3c-17cd-451c-baae-3b40d474bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f853e3c-17cd-451c-baae-3b40d474bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c40b64-fc60-4477-9874-ceeadf5ff809', 'volume_name': 'volume-45c40b64-fc60-4477-9874-ceeadf5ff809', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c909dd8b-df7c-4487-bd6a-27dbcd89a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c909dd8b-df7c-4487-bd6a-27dbcd89a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ecc12b-bf2a-44be-b4c7-4abd141dc233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:50:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Volume 45c40b64-fc60-4477-9874-ceeadf5ff809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c40b64-fc60-4477-9874-ceeadf5ff809', 'volume_size': 1}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-294186236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c40b64-fc60-4477-9874-ceeadf5ff809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddc08b5601e462db5458ab56e78b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:59Z,use_quota=True,user_id='68a32adf27564bdaa55e31de9ac18a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Creating volume 45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:50:59 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:50:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:50:59 devstack sudo[103712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 1073741824
Sep 25 11:50:59 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:50:59 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:50:59 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:00 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.453s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Deleted volume successfully.
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-99097639-fca9-4117-a062-d7087ad81766 tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-abf0792a-472c-4b3f-a21d-aaf26c666ef1-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:00 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 1073741824" returned: 0 in 0.831s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:00 devstack sudo[103722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:00 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:00 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.377s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ecc12b-bf2a-44be-b4c7-4abd141dc233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c40b64-fc60-4477-9874-ceeadf5ff809', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8085fd-d28f-4fd1-ae5f-f7ef0d6dec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Volume volume-45c40b64-fc60-4477-9874-ceeadf5ff809 (45c40b64-fc60-4477-9874-ceeadf5ff809): created successfully
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8085fd-d28f-4fd1-ae5f-f7ef0d6dec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Flow 'volume_create_manager' (b9223c96-85da-4e58-b062-89ae966884a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c2060729-ba49-4dea-87c0-395621121156 tempest-VolumeDependencyTests-1975925482 None] Created volume successfully.
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Flow 'volume_create_manager' (620582bc-e9fd-4546-92d7-90e6cf8501e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd775311-531b-4a8d-9b91-6899cb4b9e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd775311-531b-4a8d-9b91-6899cb4b9e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1472035838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8854ea-ef9d-4aca-a854-e84af5d899ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8563a02b3d354735b386281897a9c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:01Z,use_quota=True,user_id='1de3db34a23b408e9e079df6b1d3c62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398240e5-cadd-46ef-ae2c-bd96957a2e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398240e5-cadd-46ef-ae2c-bd96957a2e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb99006-a0cf-4924-b703-b007a81bc0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb99006-a0cf-4924-b703-b007a81bc0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8854ea-ef9d-4aca-a854-e84af5d899ea', 'volume_name': 'volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf5b323-caa9-4591-ba38-19454c942a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf5b323-caa9-4591-ba38-19454c942a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656a8267-5972-42ab-92cf-fa6b915c3121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:01 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Volume 3f8854ea-ef9d-4aca-a854-e84af5d899ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea', 'volume_size': 1}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1472035838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8854ea-ef9d-4aca-a854-e84af5d899ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8563a02b3d354735b386281897a9c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:01Z,use_quota=True,user_id='1de3db34a23b408e9e079df6b1d3c62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Creating volume 3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:01 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:01 devstack sudo[103725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea 1073741824
Sep 25 11:51:01 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:02 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea 1073741824" returned: 0 in 0.875s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:02 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea
Sep 25 11:51:02 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:02 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea" returned: 0 in 0.457s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Creating offline snapshot 1a68f12b-b74a-4fe1-baec-44301ef64e2d of volume 45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656a8267-5972-42ab-92cf-fa6b915c3121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e181cc-4711-4648-a2b6-2ae3ba5b9b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d7592-2cdc-4071-99df-cd6793ed8356]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:02 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Volume volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea (3f8854ea-ef9d-4aca-a854-e84af5d899ea): created successfully
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e181cc-4711-4648-a2b6-2ae3ba5b9b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Flow 'volume_create_manager' (620582bc-e9fd-4546-92d7-90e6cf8501e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-38520de2-3bc8-4c3b-8174-23bc1241871c req-2f74740b-7c75-47a8-a83f-449d78e3192b tempest-VolumesSnapshotsTestJSON-288358655 None] Created volume successfully.
Sep 25 11:51:03 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:03 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:03 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.645s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:03 devstack sudo[103767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d 1G
Sep 25 11:51:03 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:04 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d 1G" returned: 0 in 0.796s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c40b64-fc60-4477-9874-ceeadf5ff809 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:04 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c40b64-fc60-4477-9874-ceeadf5ff809 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:04 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-047183e5-8345-41aa-8aef-5d5acda5e295 req-ebf58a93-f7b8-4661-af4b-0fc039cb268a tempest-TestInstancesWithCinderVolumes-465790441 None] Terminate volume connection completed successfully.
Sep 25 11:51:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-047183e5-8345-41aa-8aef-5d5acda5e295 req-ebf58a93-f7b8-4661-af4b-0fc039cb268a tempest-TestInstancesWithCinderVolumes-465790441 None] Deleting attachment a2ecd74e-2ea8-4ca8-99d4-4b1b9d4de291. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:51:04 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c40b64-fc60-4477-9874-ceeadf5ff809 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:04 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d is being set with open permissions: ugo+rw
Sep 25 11:51:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:04 devstack sudo[103780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:04 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:05 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:05 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info
Sep 25 11:51:05 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:05 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:05 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info is being set with open permissions: ugo+rw
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:05 devstack sudo[103786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info
Sep 25 11:51:05 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:05 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.info" returned: 0 in 0.260s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.853s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Creating offline snapshot 18da1247-6d62-42a2-b626-2bd187e34bac of volume 3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:51:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9ad4d5c7-bcb0-40e9-a072-e4f188b071e1 tempest-VolumeDependencyTests-1975925482 None] Create snapshot completed successfully
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4217a7b-7407-4a94-a861-5049d695950a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:05 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea
Sep 25 11:51:05 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "cinder-quobyte-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:06 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea" returned: 0 in 0.592s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d8ea3d-d622-4734-be30-42b5d9daf60b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:06 devstack sudo[103796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac 1G
Sep 25 11:51:06 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:06 devstack sudo[103799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f
Sep 25 11:51:06 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:51:06 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac 1G" returned: 0 in 0.556s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:06 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:06 devstack sudo[103807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac
Sep 25 11:51:06 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Flow 'volume_create_manager' (39cb3a86-6b4e-4767-9876-fd901194a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c957efa1-f439-4069-ad1d-9f43fea3d6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" returned: 0 in 0.575s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c957efa1-f439-4069-ad1d-9f43fea3d6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1288000923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4d50bf-da14-4a42-aea4-696e5150f9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddc08b5601e462db5458ab56e78b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a68f12b-b74a-4fe1-baec-44301ef64e2d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:07Z,use_quota=True,user_id='68a32adf27564bdaa55e31de9ac18a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:07 devstack sudo[103809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f
Sep 25 11:51:07 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a926f0-7d8f-4f8c-97bd-dd778a0e34e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a926f0-7d8f-4f8c-97bd-dd778a0e34e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a1d648-c99a-4bc3-9f36-df2c4239ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a1d648-c99a-4bc3-9f36-df2c4239ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb4d50bf-da14-4a42-aea4-696e5150f9ae', 'volume_name': 'volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae', 'volume_size': 1, 'snapshot_id': '1a68f12b-b74a-4fe1-baec-44301ef64e2d'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccd3fdb-aa32-443c-b817-e5b0728687fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccd3fdb-aa32-443c-b817-e5b0728687fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef1db3c-fc64-4042-a081-2ca20a8749d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Volume eb4d50bf-da14-4a42-aea4-696e5150f9ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae', 'volume_size': 1, 'snapshot_id': '1a68f12b-b74a-4fe1-baec-44301ef64e2d'}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:07 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:07 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac" returned: 0 in 0.363s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:07 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac is being set with open permissions: ugo+rw
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:07 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac
Sep 25 11:51:07 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-quobyte-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f" released by "delete_volume" :: held 0.977s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:07 devstack cinder-volume[87358]: WARNING cinder.quota [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294192970-609882234 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294192970-609882234, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:51:07 devstack cinder-volume[87358]: WARNING cinder.quota [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294192970-609882234 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294192970-609882234, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Created reservations ['e824eb9a-2c4f-4db2-aaf4-18dee55839d9', '33aca234-db78-4d34-b2d1-21b7385a1a1e', '41dec380-a5d2-4678-b895-7fd2c4a1ad65', '9fd26bdb-61f4-442f-9ddd-6f15635c7b81'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:07 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:07 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:07 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:07 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info
Sep 25 11:51:07 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:07 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.318s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Deleted volume successfully.
Sep 25 11:51:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77f46d8f-fa50-444a-8119-64352b69165f tempest-TestInstancesWithCinderVolumes-465790441 None] Lock "cinder-07aa7f5e-e9dc-4b8f-9af0-5d6593f9006f-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:08 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:08 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info is being set with open permissions: ugo+rw
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:08 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info
Sep 25 11:51:08 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:08 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.info" returned: 0 in 0.340s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.404s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d-eb4d50bf-da14-4a42-aea4-696e5150f9ae" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d-eb4d50bf-da14-4a42-aea4-696e5150f9ae" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Creating volume eb4d50bf-da14-4a42-aea4-696e5150f9ae from snapshot 1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-63570d67-5fa1-4054-9679-4b503de14abf req-556526e8-3fc6-4aa7-9b76-004a91d30cc6 tempest-VolumesSnapshotsTestJSON-288358655 None] Create snapshot completed successfully
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] snapshot: 1a68f12b-b74a-4fe1-baec-44301ef64e2d, volume: eb4d50bf-da14-4a42-aea4-696e5150f9ae,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0b2e0-ffed-4dd5-867b-1b7c391a9cf0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:08 devstack sudo[103831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:08 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:09 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.463s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c40b64-fc60-4477-9874-ceeadf5ff809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8faffcf-70ba-452d-b965-57b9360ea010]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:09 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:09 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:09 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:09 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae
Sep 25 11:51:09 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "cinder-18da1247-6d62-42a2-b626-2bd187e34bac-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-18da1247-6d62-42a2-b626-2bd187e34bac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "cinder-quobyte-18da1247-6d62-42a2-b626-2bd187e34bac" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-18da1247-6d62-42a2-b626-2bd187e34bac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Deleting offline snapshot 18da1247-6d62-42a2-b626-2bd187e34bac of volume 3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] snapshot_file for this snap is: volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eae79b-3fdb-4bdf-9034-47d8b5ff54e4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:10 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac
Sep 25 11:51:10 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:10 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac" returned: 0 in 0.709s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:51:10 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f6001-71e3-42ab-8e5a-ccb7ff4cca4c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:10 devstack sudo[103859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea
Sep 25 11:51:10 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:11 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea" returned: 0 in 1.191s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:11 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac
Sep 25 11:51:11 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:12 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac" returned: 0 in 0.971s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:12 devstack sudo[103870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac
Sep 25 11:51:12 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:13 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea.18da1247-6d62-42a2-b626-2bd187e34bac" returned: 0 in 0.627s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=202,cinder:SELECT=154,cinder:INSERT=41,cinder:DELETE=15 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=145,cinder:INSERT=48,cinder:UPDATE=179,cinder:DELETE=16 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-18da1247-6d62-42a2-b626-2bd187e34bac" released by "_delete_snapshot" :: held 3.817s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" released by "delete_snapshot" :: held 3.863s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:13 devstack cinder-volume[87358]: DEBUG cinder.quota [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Created reservations ['df50c808-5e0d-4fce-a65a-d3d0e7f1c0b3', '8b204f91-b461-421b-93cd-abfdeefdb3e5', 'f7b9f4e7-aa2f-46f1-a04e-75b827248249', 'ffa62ae9-2a8b-4e2c-ba45-ca1b60651e98'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Delete snapshot completed successfully.
Sep 25 11:51:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-d34d3bc3-8fa7-48ad-8903-828296ec904d req-03203e5a-abb5-4257-b023-685ecb51c2ea tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-18da1247-6d62-42a2-b626-2bd187e34bac-delete_snapshot" released by "delete_snapshot" :: held 4.220s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "cinder-3f8854ea-ef9d-4aca-a854-e84af5d899ea-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-3f8854ea-ef9d-4aca-a854-e84af5d899ea-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" acquired by "delete_volume" :: waited 0.047s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[df205f76-5614-486b-b434-9b3d0caa6c1e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:15 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea
Sep 25 11:51:15 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:16 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea" returned: 0 in 1.320s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:16 devstack sudo[103881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea
Sep 25 11:51:16 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:16 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3f8854ea-ef9d-4aca-a854-e84af5d899ea" returned: 0 in 0.430s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-quobyte-3f8854ea-ef9d-4aca-a854-e84af5d899ea" released by "delete_volume" :: held 1.937s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:16 devstack cinder-volume[87358]: DEBUG cinder.quota [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Created reservations ['0219da9b-c4f1-4d1b-a2fd-437bcb5769db', '677248db-ac6c-446a-aa1b-566ab859c9a6', '0e812bc9-26ae-4854-9303-516dcaf0d310', '4760828a-1f96-410c-a869-853990f0e431'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:17 devstack sudo[103884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:17 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:18 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.845s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:18 devstack cinder-volume[87358]: DEBUG cinder.manager [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Deleted volume successfully.
Sep 25 11:51:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [req-696c213f-7b6d-4005-a797-d1e2f016c898 req-7ee86290-7dd8-4721-814e-db9370dbd1b0 tempest-VolumesSnapshotsTestJSON-288358655 None] Lock "cinder-3f8854ea-ef9d-4aca-a854-e84af5d899ea-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:19 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae" returned: 0 in 9.490s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:51:19 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Converted 1024.00 MB image at 107.87 MB/s
Sep 25 11:51:19 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae is being set with open permissions: ugo+rw
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:19 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae
Sep 25 11:51:19 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:19 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" released by "_copy_volume_from_snapshot" :: held 10.901s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d-eb4d50bf-da14-4a42-aea4-696e5150f9ae" released by "_create_volume_from_snapshot" :: held 11.026s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.070s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef1db3c-fc64-4042-a081-2ca20a8749d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae', 'volume_size': 1, 'snapshot_id': '1a68f12b-b74a-4fe1-baec-44301ef64e2d'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9348615-370d-4837-b299-d69c1e372d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Volume volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae (eb4d50bf-da14-4a42-aea4-696e5150f9ae): created successfully
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9348615-370d-4837-b299-d69c1e372d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Flow 'volume_create_manager' (39cb3a86-6b4e-4767-9876-fd901194a71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f016dbe9-37ab-4eab-81f9-5a96206259d6 tempest-VolumeDependencyTests-1975925482 None] Created volume successfully.
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-1a68f12b-b74a-4fe1-baec-44301ef64e2d-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-1a68f12b-b74a-4fe1-baec-44301ef64e2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Deleting offline snapshot 1a68f12b-b74a-4fe1-baec-44301ef64e2d of volume 45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] snapshot_file for this snap is: volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2666e6c-5a32-4aea-b4b2-fc31a840ff76]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:21 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:21 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:21 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.558s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c40b64-fc60-4477-9874-ceeadf5ff809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:51:21 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b7b1c-854e-420d-b403-aee31a873635]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:21 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:21 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:22 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.809s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:22 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:22 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:22 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.533s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:22 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d
Sep 25 11:51:22 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:23 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809.1a68f12b-b74a-4fe1-baec-44301ef64e2d" returned: 0 in 0.358s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-1a68f12b-b74a-4fe1-baec-44301ef64e2d" released by "_delete_snapshot" :: held 2.430s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" released by "delete_snapshot" :: held 2.469s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Created reservations ['7faa4575-bce4-44b7-a29f-e55880646ec1', 'db89f95a-6835-4c5f-b8a2-f23c4068c955', '5ac8efcf-0830-4d46-a58e-7b340314cac7', '405596b3-03b2-4a8b-9557-e564e55debbb'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Delete snapshot completed successfully.
Sep 25 11:51:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eca81d04-4bb1-47e9-949f-8c0fcd8d31ce tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-1a68f12b-b74a-4fe1-baec-44301ef64e2d-delete_snapshot" released by "delete_snapshot" :: held 2.709s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-45c40b64-fc60-4477-9874-ceeadf5ff809-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-45c40b64-fc60-4477-9874-ceeadf5ff809-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a0286-836e-4c03-9c53-3c48d628d738]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:24 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:24 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:24 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.520s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:24 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809
Sep 25 11:51:24 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d16d9ee-2a61-4030-9767-25c6438dd066 tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-93755659: creating
Sep 25 11:51:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d16d9ee-2a61-4030-9767-25c6438dd066 tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-93755659: created successfully
Sep 25 11:51:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d16d9ee-2a61-4030-9767-25c6438dd066 tempest-GroupSnapshotsTest-994378603 None] Create group completed successfully.
Sep 25 11:51:25 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-45c40b64-fc60-4477-9874-ceeadf5ff809" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-45c40b64-fc60-4477-9874-ceeadf5ff809" released by "delete_volume" :: held 0.941s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Created reservations ['f1d4cd69-cc7e-4d6a-9447-55fa800021cc', 'eff68741-85cc-4e05-a396-99ea4285f472', '7bffdc22-2247-46a4-8c5f-712734a51ff0', 'cfe42886-e587-442a-99d5-dbf5dc4efbf3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:25 devstack sudo[103918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:25 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-eb4d50bf-da14-4a42-aea4-696e5150f9ae-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-eb4d50bf-da14-4a42-aea4-696e5150f9ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d86bc6-be60-4908-813a-f452f792cf3e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:25 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae
Sep 25 11:51:25 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:25 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Deleted volume successfully.
Sep 25 11:51:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-29092417-76ac-43cb-937b-8472c348d1c3 tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-45c40b64-fc60-4477-9874-ceeadf5ff809-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:26 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae" returned: 0 in 0.508s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:26 devstack sudo[103927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae
Sep 25 11:51:26 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:26 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-eb4d50bf-da14-4a42-aea4-696e5150f9ae" returned: 0 in 0.346s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-quobyte-eb4d50bf-da14-4a42-aea4-696e5150f9ae" released by "delete_volume" :: held 0.918s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Created reservations ['292c614a-0331-41ac-9e63-a6f247e061d7', '746f2818-c578-4268-8332-15deb82177b5', '0f57873c-3bae-4412-903e-0daed7152115', '421e0190-41aa-4e0d-8441-e5d15cb09c5a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:26 devstack sudo[103930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:26 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (feb03748-3aa1-4581-822a-bf44baf4ebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ede6ec-04f8-4820-a6c5-4be1864c452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ede6ec-04f8-4820-a6c5-4be1864c452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167592584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57b3420f-d25d-4076-a41d-4f35ea05ddd4,host='devstack@QuobyteHD#QuobyteHD',id=2f3e1e1a-8b06-4916-8b49-1aa0e6824871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:27Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b798890-a638-434f-b221-0c9e32806144),volume_type_id=7b798890-a638-434f-b221-0c9e32806144)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294ce891-702e-4f01-a0c5-24e9454ff42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294ce891-702e-4f01-a0c5-24e9454ff42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b33ca3c-eb28-432c-b069-a478cb328cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b33ca3c-eb28-432c-b069-a478cb328cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3e1e1a-8b06-4916-8b49-1aa0e6824871', 'volume_name': 'volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949eaccf-7741-40dc-a668-99ea715fa56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949eaccf-7741-40dc-a668-99ea715fa56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc129089-6d53-401e-b271-e4b8196ba110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Volume 2f3e1e1a-8b06-4916-8b49-1aa0e6824871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871', 'volume_size': 1}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=57b3420f-d25d-4076-a41d-4f35ea05ddd4,created_at=2026-09-25T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167592584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57b3420f-d25d-4076-a41d-4f35ea05ddd4,host='devstack@QuobyteHD#QuobyteHD',id=2f3e1e1a-8b06-4916-8b49-1aa0e6824871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:27Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b798890-a638-434f-b221-0c9e32806144),volume_type_id=7b798890-a638-434f-b221-0c9e32806144)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Creating volume 2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:27 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:27 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:27 devstack sudo[103933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 1073741824
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.516s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:27 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Deleted volume successfully.
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cadffaf5-8d80-43e2-a3c0-137fd1f22d5b tempest-VolumeDependencyTests-1975925482 None] Lock "cinder-eb4d50bf-da14-4a42-aea4-696e5150f9ae-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:27 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 1073741824" returned: 0 in 0.731s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:27 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:27 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:28 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc129089-6d53-401e-b271-e4b8196ba110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84aa7ac-500d-48d7-8496-d971b97fe25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Volume volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 (2f3e1e1a-8b06-4916-8b49-1aa0e6824871): created successfully
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84aa7ac-500d-48d7-8496-d971b97fe25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (feb03748-3aa1-4581-822a-bf44baf4ebf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-26b8438f-8c67-4e66-a43d-f013a318711b tempest-GroupSnapshotsTest-994378603 None] Created volume successfully.
Sep 25 11:51:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] GroupSnapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: creating.
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Group snapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: creating. {{(pid=87358) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Creating offline snapshot 0e9956ab-1acf-4813-91be-f446410c62ce of volume 2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e5b54-365f-4bf6-ae7d-6b27abff7dc3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:30 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:30 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:30 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 0.536s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:30 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce 1G
Sep 25 11:51:30 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:30 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce 1G" returned: 0 in 0.534s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:30 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:30 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:31 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.477s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:31 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:51:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:31 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:31 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:31 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:31 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info
Sep 25 11:51:31 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:32 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info" returned: 0 in 0.373s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:32 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:51:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:32 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info
Sep 25 11:51:32 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:32 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.info" returned: 0 in 0.390s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e9b93fbf-39a7-49fe-8276-a7a647537148 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: created successfully
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce-945494d9-3212-4693-8c16-78e2de827c81" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce-945494d9-3212-4693-8c16-78e2de827c81" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Creating volume 945494d9-3212-4693-8c16-78e2de827c81 from snapshot 0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] snapshot: 0e9956ab-1acf-4813-91be-f446410c62ce, volume: 945494d9-3212-4693-8c16-78e2de827c81,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ecb43c-bc75-47d7-a11a-a72ca3fa74d2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:34 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:34 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:34 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.532s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0787c86-8b82-4fd1-b21f-4b41b9243291]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:35 devstack sudo[103984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:35 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:35 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 0.538s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:51:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:51:35 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:51:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:35 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81
Sep 25 11:51:35 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Flow 'volume_create_manager' (f0d3506c-ef4b-4b8e-8909-75303598f197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c85d4db-634b-4115-b910-e4a21700bbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c85d4db-634b-4115-b910-e4a21700bbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc8e6d7-9906-462b-bc10-f64e955bc53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569599f40b9484aad0be6958803b420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:36Z,use_quota=True,user_id='1c0196fd21f3407aaebb51b87ac1cf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c8fb6b-bbef-46cb-bd9b-d9fca5e35718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c8fb6b-bbef-46cb-bd9b-d9fca5e35718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4f81af-46d2-48ff-913f-e34312498253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4f81af-46d2-48ff-913f-e34312498253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bc8e6d7-9906-462b-bc10-f64e955bc53a', 'volume_name': 'volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a', 'volume_size': 1, 'image_id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a90cf99f53620d4b2c1f7288a81e56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8569599f40b9484aad0be6958803b420', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3db692827a48f2302f77dea161063bcb16dbd0a62170e87b1327c5ba624434b7045a4a64b79c7f61138d5c51ff182cf78d821cc42e0aad3a0bb25f9fafe8eb6', 'id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f341480-5f15-4df1-b71d-df2aa66bae1e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d6337bc0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e61277-b1b5-45f5-bb84-4bb913731692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e61277-b1b5-45f5-bb84-4bb913731692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58f4b6e-13af-4a05-837f-3ac621c7674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a', 'volume_size': 1, 'image_id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a90cf99f53620d4b2c1f7288a81e56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8569599f40b9484aad0be6958803b420', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3db692827a48f2302f77dea161063bcb16dbd0a62170e87b1327c5ba624434b7045a4a64b79c7f61138d5c51ff182cf78d821cc42e0aad3a0bb25f9fafe8eb6', 'id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f341480-5f15-4df1-b71d-df2aa66bae1e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d6337bc0>}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Trying to clone 3bc8e6d7-9906-462b-bc10-f64e955bc53a from image 0f341480-5f15-4df1-b71d-df2aa66bae1e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:51:36 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:51:36 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 11:51:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0f65b-6299-4484-bfbf-08bdd9e15239]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:37 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:37 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:37 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:38 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:38 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:39 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 1 in 1.234s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:51:39 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Temporary image 0f341480-5f15-4df1-b71d-df2aa66bae1e is fetched for user 1c0196fd21f3407aaebb51b87ac1cf09. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:51:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd06460d-0ae1-4990-b5f3-cde10dbc234e]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:39 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:39 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:40 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:40 devstack sudo[104018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:40 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:40 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 1 in 0.864s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:51:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:45 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81" returned: 0 in 9.741s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871, size 1024.00 MB, duration 9.74 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:51:45 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Converted 1024.00 MB image at 105.10 MB/s
Sep 25 11:51:45 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:45 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81
Sep 25 11:51:45 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:45 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" released by "_copy_volume_from_snapshot" :: held 11.341s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce-945494d9-3212-4693-8c16-78e2de827c81" released by "_create_volume_from_snapshot" :: held 11.462s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.490s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.721s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc8e6d7-9906-462b-bc10-f64e955bc53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569599f40b9484aad0be6958803b420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:36Z,use_quota=True,user_id='1c0196fd21f3407aaebb51b87ac1cf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Creating volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:45 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:51:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:45 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1073741824
Sep 25 11:51:45 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2fcc73d7-8cb4-48a5-8f7a-887a43dfe968 tempest-GroupSnapshotsTest-994378603 None] Create group from source-snapshot-0c6469b0-f2d1-4504-b6bb-2986483ef46e completed successfully.
Sep 25 11:51:46 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1073741824" returned: 0 in 0.651s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:46 devstack sudo[104033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a
Sep 25 11:51:46 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:46 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a" returned: 0 in 0.345s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Attempting download of 0f341480-5f15-4df1-b71d-df2aa66bae1e ((None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}])) to volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[062f8606-37d6-41b6-8074-e128817dda7a]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:46 devstack sudo[104036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy
Sep 25 11:51:46 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:47 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy" returned: 0 in 0.418s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:47 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy
Sep 25 11:51:47 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e666e-e372-47e3-bb90-c5b82b96d5f3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:47 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81
Sep 25 11:51:47 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:47 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy" returned: 1 in 0.495s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f341480-5f15-4df1-b71d-df2aa66bae1e_djbwkhyy' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bcb72b-e3fc-484e-9dc8-0ae38888e820]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:47 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:47 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:48 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81" returned: 0 in 0.568s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:48 devstack sudo[104051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81
Sep 25 11:51:48 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:48 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:48 devstack sudo[104055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD
Sep 25 11:51:48 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:48 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-945494d9-3212-4693-8c16-78e2de827c81" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-945494d9-3212-4693-8c16-78e2de827c81" released by "delete_volume" :: held 1.007s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Created reservations ['35da724b-e2dc-4cd2-bacd-a3f14ed591f9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:48 devstack cinder-volume[87358]: WARNING cinder.quota [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-352159311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-352159311, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:51:48 devstack cinder-volume[87358]: WARNING cinder.quota [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-352159311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-352159311, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:51:48 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] 0f341480-5f15-4df1-b71d-df2aa66bae1e was raw, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Created reservations ['a223752a-eefe-42d8-b37b-e2e4fafe0efd', '5781f44b-2029-4ce3-92a1-bb2f39da9874', 'f9fd4d60-a5a4-4bf9-84fb-621f0f0868a4', '9756d42b-99c0-4366-ad7e-0e28488758ab'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:48 devstack sudo[104061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a
Sep 25 11:51:48 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:48 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:48 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:49 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.387s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:49 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e027aae2-4b38-4ca2-aa7b-bab79e96bc4d tempest-GroupSnapshotsTest-994378603 None] Delete group completed successfully.
Sep 25 11:51:49 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a" returned: 0 in 0.807s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:49 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f341480-5f15-4df1-b71d-df2aa66bae1e_1ykx6sf_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:51:49 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 11:51:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:49 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1G
Sep 25 11:51:49 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:50 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a 1G" returned: 0 in 0.607s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Downloaded image 0f341480-5f15-4df1-b71d-df2aa66bae1e ((None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}])) to volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Temporary image 0f341480-5f15-4df1-b71d-df2aa66bae1e for user 1c0196fd21f3407aaebb51b87ac1cf09 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Marking volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:51:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: deleting
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Copying metadata from image 0f341480-5f15-4df1-b71d-df2aa66bae1e to 3bc8e6d7-9906-462b-bc10-f64e955bc53a. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Creating volume glance metadata for volume 3bc8e6d7-9906-462b-bc10-f64e955bc53a backed by image 0f341480-5f15-4df1-b71d-df2aa66bae1e with: {'image_id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4a90cf99f53620d4b2c1f7288a81e56e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: deleting {{(pid=87358) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Deleting offline snapshot 0e9956ab-1acf-4813-91be-f446410c62ce of volume 2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] snapshot_file for this snap is: volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58f4b6e-13af-4a05-837f-3ac621c7674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a', 'volume_size': 1, 'image_id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f341480-5f15-4df1-b71d-df2aa66bae1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a90cf99f53620d4b2c1f7288a81e56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8569599f40b9484aad0be6958803b420', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3db692827a48f2302f77dea161063bcb16dbd0a62170e87b1327c5ba624434b7045a4a64b79c7f61138d5c51ff182cf78d821cc42e0aad3a0bb25f9fafe8eb6', 'id': '0f341480-5f15-4df1-b71d-df2aa66bae1e', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f341480-5f15-4df1-b71d-df2aa66bae1e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d6337bc0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8bfe1f-9c39-4d4a-8732-f3ce72be02ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[936149b7-e3db-45f7-bc4e-bac4499de519]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:50 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Volume volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a (3bc8e6d7-9906-462b-bc10-f64e955bc53a): created successfully
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8bfe1f-9c39-4d4a-8732-f3ce72be02ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Flow 'volume_create_manager' (f0d3506c-ef4b-4b8e-8909-75303598f197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-96f2652b-9b62-4c1e-b5a0-057474577d70 tempest-VolumeImageDependencyTests-2120357458 None] Created volume successfully.
Sep 25 11:51:50 devstack sudo[104076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:50 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:50 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.528s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b0d8b-44c5-44e6-958c-dca4b9edb23c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:51 devstack sudo[104081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:51 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Acquiring lock "cinder-3bc8e6d7-9906-462b-bc10-f64e955bc53a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "cinder-3bc8e6d7-9906-462b-bc10-f64e955bc53a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Acquiring lock "cinder-quobyte-3bc8e6d7-9906-462b-bc10-f64e955bc53a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "cinder-quobyte-3bc8e6d7-9906-462b-bc10-f64e955bc53a" acquired by "delete_volume" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f8a07e-0455-4bc2-b19a-a52f02812e91]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:51 devstack sudo[104120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:51 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:51 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a
Sep 25 11:51:51 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:51 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 1.062s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:52 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:52 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:52 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.530s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:51:52 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a" returned: 0 in 0.804s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:52 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a
Sep 25 11:51:52 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:52 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.538s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:52 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3bc8e6d7-9906-462b-bc10-f64e955bc53a" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:52 devstack sudo[104140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "cinder-quobyte-3bc8e6d7-9906-462b-bc10-f64e955bc53a" released by "delete_volume" :: held 1.280s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:52 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Created reservations ['fa895b36-1b2c-451b-a2a3-768b14df3159', '874dd391-6951-4560-97e8-9e4f2a54fcce', 'c246e092-e18e-4387-b88c-912ac8c71db9', 'aefeff77-2f29-4c28-ac08-800f6ea82597'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:52 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:52 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:52 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871.0e9956ab-1acf-4813-91be-f446410c62ce" returned: 0 in 0.349s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-0e9956ab-1acf-4813-91be-f446410c62ce" released by "_delete_snapshot" :: held 2.682s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" released by "delete_snapshot" :: held 2.739s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:53 devstack cinder-volume[87358]: WARNING cinder.quota [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-352159311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-352159311, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:51:53 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['0ad38e47-fa19-4aba-a54b-82307a2e8e7d', '290ff579-1937-47cc-929c-664751bfab4f', 'be1e1449-654e-4c3b-8437-296492b1f0e9', '8f845e0b-e44c-43b2-b6c2-e92dd0cdd2a3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:53 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.365s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:53 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Deleted volume successfully.
Sep 25 11:51:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a97fdd12-8343-459e-a5c9-60274e534f9a tempest-VolumeImageDependencyTests-2120357458 None] Lock "cinder-3bc8e6d7-9906-462b-bc10-f64e955bc53a-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-367f581d-9e6d-402a-a3d9-e6bc5a192505 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 0c6469b0-f2d1-4504-b6bb-2986483ef46e: deleted successfully
Sep 25 11:51:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:51:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" acquired by "delete_volume" :: waited 0.044s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:51:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b014c-3054-4489-8115-ba28c411b029]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:51:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:54 devstack sudo[104146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:54 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:54 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 0.505s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:54 devstack sudo[104151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871
Sep 25 11:51:54 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:55 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-2f3e1e1a-8b06-4916-8b49-1aa0e6824871" released by "delete_volume" :: held 1.074s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Created reservations ['2a91456d-e2c1-4e62-b711-2da9fb5b3fce'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:55 devstack cinder-volume[87358]: WARNING cinder.db.api [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-352159311']
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Created reservations ['0501deb6-a0be-4c64-8dd4-9a0675a2f5f4', 'ffeff353-966c-489c-b75f-8679bdc739f4', 'f41308be-2112-4c1a-9157-fa16837d3c5d', 'fd5fc893-b116-4deb-811e-7dfa941952a0'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:55 devstack sudo[104154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:51:55 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:51:55 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.393s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:51:55 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:51:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-aade2938-beb2-4047-b32f-a07767e8543d tempest-GroupSnapshotsTest-994378603 None] Delete group completed successfully.
Sep 25 11:51:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f1e2c8f2-774f-488e-a296-9f2712b773fb tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-295199485: creating
Sep 25 11:51:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f1e2c8f2-774f-488e-a296-9f2712b773fb tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-295199485: created successfully
Sep 25 11:51:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f1e2c8f2-774f-488e-a296-9f2712b773fb tempest-GroupSnapshotsTest-994378603 None] Create group completed successfully.
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (aaf53509-9419-4cf2-b170-c372fdcdea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8343046-7dee-4114-8fd7-5f38678928d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8343046-7dee-4114-8fd7-5f38678928d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-674506412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=819d3326-e223-473d-80c8-84b6e46ababc,host='devstack@QuobyteHD#QuobyteHD',id=81091fce-5d01-4067-ac2f-a843c18491eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:59Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f72c91-b120-4e3c-b636-4b0ca765b57a),volume_type_id=d6f72c91-b120-4e3c-b636-4b0ca765b57a)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b9f17b-119f-42b9-a8c0-60004acd92eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b9f17b-119f-42b9-a8c0-60004acd92eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9fa899-95a7-47a3-b917-7eba0d3f9cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9fa899-95a7-47a3-b917-7eba0d3f9cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81091fce-5d01-4067-ac2f-a843c18491eb', 'volume_name': 'volume-81091fce-5d01-4067-ac2f-a843c18491eb', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ec1c71-7cf2-4ffd-8b10-1e06619d57bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ec1c71-7cf2-4ffd-8b10-1e06619d57bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef509b-8d64-493f-8437-b57bccd2fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:51:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Volume 81091fce-5d01-4067-ac2f-a843c18491eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81091fce-5d01-4067-ac2f-a843c18491eb', 'volume_size': 1}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=819d3326-e223-473d-80c8-84b6e46ababc,created_at=2026-09-25T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-674506412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=819d3326-e223-473d-80c8-84b6e46ababc,host='devstack@QuobyteHD#QuobyteHD',id=81091fce-5d01-4067-ac2f-a843c18491eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:59Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f72c91-b120-4e3c-b636-4b0ca765b57a),volume_type_id=d6f72c91-b120-4e3c-b636-4b0ca765b57a)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Creating volume 81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:51:59 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:51:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:51:59 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb 1073741824
Sep 25 11:51:59 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:00 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb 1073741824" returned: 0 in 0.740s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:00 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb
Sep 25 11:52:00 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:00 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb" returned: 0 in 0.426s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef509b-8d64-493f-8437-b57bccd2fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81091fce-5d01-4067-ac2f-a843c18491eb', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73998876-93d9-4948-b230-633e609afcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Volume volume-81091fce-5d01-4067-ac2f-a843c18491eb (81091fce-5d01-4067-ac2f-a843c18491eb): created successfully
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73998876-93d9-4948-b230-633e609afcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (aaf53509-9419-4cf2-b170-c372fdcdea11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b4731897-7d94-4b38-8906-1b06d86e1400 tempest-GroupSnapshotsTest-994378603 None] Created volume successfully.
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (d56eeec2-316c-4f44-855e-96233073cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1ff54-905f-43f6-880c-1ca3be2542ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1ff54-905f-43f6-880c-1ca3be2542ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376510426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=819d3326-e223-473d-80c8-84b6e46ababc,host='devstack@QuobyteHD#QuobyteHD',id=ac13a8bd-3710-4e93-9c2e-8f71f69630bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:03Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f72c91-b120-4e3c-b636-4b0ca765b57a),volume_type_id=d6f72c91-b120-4e3c-b636-4b0ca765b57a)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288de0a0-0b52-4c0e-87ce-cf12146006c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288de0a0-0b52-4c0e-87ce-cf12146006c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f97121-46e0-404e-9a1b-d75d7da3d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f97121-46e0-404e-9a1b-d75d7da3d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac13a8bd-3710-4e93-9c2e-8f71f69630bd', 'volume_name': 'volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4934e671-d5af-40a7-83d7-5f1b23cae9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4934e671-d5af-40a7-83d7-5f1b23cae9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59782530-ff2b-44b7-a917-d1af80484a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Volume ac13a8bd-3710-4e93-9c2e-8f71f69630bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd', 'volume_size': 1}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=819d3326-e223-473d-80c8-84b6e46ababc,created_at=2026-09-25T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376510426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=819d3326-e223-473d-80c8-84b6e46ababc,host='devstack@QuobyteHD#QuobyteHD',id=ac13a8bd-3710-4e93-9c2e-8f71f69630bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:03Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f72c91-b120-4e3c-b636-4b0ca765b57a),volume_type_id=d6f72c91-b120-4e3c-b636-4b0ca765b57a)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Creating volume ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:52:03 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:03 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd 1073741824
Sep 25 11:52:03 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:03 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd 1073741824" returned: 0 in 0.743s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:04 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd
Sep 25 11:52:04 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:04 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59782530-ff2b-44b7-a917-d1af80484a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333938a4-3417-43f4-a063-6bb8cb91a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Volume volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd (ac13a8bd-3710-4e93-9c2e-8f71f69630bd): created successfully
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333938a4-3417-43f4-a063-6bb8cb91a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (d56eeec2-316c-4f44-855e-96233073cf87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-23f26e09-fb12-4e2f-a993-2c19819f1ed1 tempest-GroupSnapshotsTest-994378603 None] Created volume successfully.
Sep 25 11:52:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1aa3d5a6-332f-4a50-ad92-820d39c6e1bf tempest-GroupSnapshotsTest-994378603 None] Update group completed successfully.
Sep 25 11:52:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-24d2d3d8-242e-42ed-bfad-8cfe5ab78e5a tempest-GroupSnapshotsTest-994378603 None] Update group completed successfully.
Sep 25 11:52:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cba48761-7a7f-46e3-84b0-7d1ae73a133f tempest-GroupSnapshotsTest-994378603 None] Update group completed successfully.
Sep 25 11:52:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0cbc711f-d7f1-41f8-adca-dffd2874e20d tempest-GroupSnapshotsTest-994378603 None] Update group completed successfully.
Sep 25 11:52:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] GroupSnapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: creating.
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Group snapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: creating. {{(pid=87358) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Creating offline snapshot ed8b5317-33ab-4a03-9755-e279ee70f20a of volume ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[39418cbf-5f59-4bab-8039-7c91ea14ff6a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:11 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd
Sep 25 11:52:11 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:11 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" returned: 0 in 0.419s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:11 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a 1G
Sep 25 11:52:11 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:12 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a 1G" returned: 0 in 0.530s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:12 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a
Sep 25 11:52:12 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:12 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:12 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:12 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a
Sep 25 11:52:12 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:13 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:13 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info
Sep 25 11:52:13 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:13 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:13 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:13 devstack sudo[104205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info
Sep 25 11:52:13 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:13 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.info" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:13 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=86,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:52:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Creating offline snapshot edcc18da-3049-4336-b5cc-99ab27e32fe2 of volume 81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:52:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7275d36-c0d9-48fe-b5dd-b84ab3e1ba2e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:14 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb
Sep 25 11:52:14 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:14 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb" returned: 0 in 0.632s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:14 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 1G
Sep 25 11:52:14 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:15 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 1G" returned: 0 in 0.716s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81091fce-5d01-4067-ac2f-a843c18491eb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:15 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81091fce-5d01-4067-ac2f-a843c18491eb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2
Sep 25 11:52:15 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:15 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81091fce-5d01-4067-ac2f-a843c18491eb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2" returned: 0 in 0.433s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:15 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:15 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2
Sep 25 11:52:15 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:16 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2" returned: 0 in 0.376s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=104,cinder:INSERT=28,cinder:UPDATE=95,cinder:DELETE=4 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:16 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info
Sep 25 11:52:16 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:16 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info" returned: 0 in 0.323s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:16 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:16 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info
Sep 25 11:52:16 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:16 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.info" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-dbc97aeb-15a6-4c63-a7c6-c4d0bf35335b tempest-GroupSnapshotsTest-994378603 None] group_snapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: created successfully
Sep 25 11:52:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: deleting
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: deleting {{(pid=87358) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-ed8b5317-33ab-4a03-9755-e279ee70f20a" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ed8b5317-33ab-4a03-9755-e279ee70f20a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Deleting offline snapshot ed8b5317-33ab-4a03-9755-e279ee70f20a of volume ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] snapshot_file for this snap is: volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9c48a-74f4-4a2a-b09d-f7662de21fb3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:18 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a
Sep 25 11:52:18 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:19 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a" returned: 0 in 0.708s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[11224709-eb53-4ee0-b4e6-dbabae33bfb9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:19 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd
Sep 25 11:52:19 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:19 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:19 devstack sudo[104353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a
Sep 25 11:52:19 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:20 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a" returned: 0 in 0.453s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:20 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a
Sep 25 11:52:20 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:20 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd.ed8b5317-33ab-4a03-9755-e279ee70f20a" returned: 0 in 0.317s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ed8b5317-33ab-4a03-9755-e279ee70f20a" released by "_delete_snapshot" :: held 2.146s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" released by "delete_snapshot" :: held 2.184s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-edcc18da-3049-4336-b5cc-99ab27e32fe2" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-edcc18da-3049-4336-b5cc-99ab27e32fe2" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Deleting offline snapshot edcc18da-3049-4336-b5cc-99ab27e32fe2 of volume 81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] snapshot_file for this snap is: volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d08326-7e9a-4f2b-bfe6-8b159c34ae8d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:20 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2
Sep 25 11:52:20 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:21 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2" returned: 0 in 0.515s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81091fce-5d01-4067-ac2f-a843c18491eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58bd24-2b4c-401a-8884-6567f2cb0b9d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:21 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb
Sep 25 11:52:21 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:21 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb" returned: 0 in 0.505s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:21 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2
Sep 25 11:52:21 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:22 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2" returned: 0 in 0.513s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:22 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2
Sep 25 11:52:22 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:22 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb.edcc18da-3049-4336-b5cc-99ab27e32fe2" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-edcc18da-3049-4336-b5cc-99ab27e32fe2" released by "_delete_snapshot" :: held 2.035s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" released by "delete_snapshot" :: held 2.079s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:22 devstack cinder-volume[87358]: WARNING cinder.quota [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-747753255 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-747753255, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:22 devstack cinder-volume[87358]: WARNING cinder.quota [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-747753255 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-747753255, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['2bbc2920-6ebf-46d9-b2d0-30a5b173f588', '3e84f178-6179-4be5-8c2b-dffac82a9d3b', '84147dc3-f826-4846-8e1f-ba2a5f8c5236', 'af8a480d-c1f9-4cf1-94af-01215e105e12'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['21ff2ec4-360c-4626-bf87-d67843686f44', '84b94d41-f99d-4330-b924-b41dc02da6db', '5211ed2c-5111-46c9-97c7-5ffe300ad3f2', 'd1ff1c11-e636-4d50-93be-f79cf2b81a16'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-966624d1-5440-441a-a1c7-3b85bcdd6b30 tempest-GroupSnapshotsTest-994378603 None] group_snapshot 6d9cfabe-3ca0-40be-ae83-d4a96eb9e42d: deleted successfully
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Flow 'volume_create_manager' (ce18551a-d3eb-4de4-be6e-7f670863f561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4386c943-9188-4b75-92bf-d2008babe1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4386c943-9188-4b75-92bf-d2008babe1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1704930480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498976c7-3449-45c9-b586-cf08b6333411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bf95f146ba4b5fa9b46ff46d064440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:24Z,use_quota=True,user_id='3dc0b0f0b3ed497bbd8381a98675ec57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ceb7c-085f-446e-8682-b22e53a28845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ceb7c-085f-446e-8682-b22e53a28845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c10050-9064-44d8-8e0d-c7817c870372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c10050-9064-44d8-8e0d-c7817c870372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498976c7-3449-45c9-b586-cf08b6333411', 'volume_name': 'volume-498976c7-3449-45c9-b586-cf08b6333411', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d47327-846e-45e6-a0b0-ce13b5dec53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d47327-846e-45e6-a0b0-ce13b5dec53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f085560-4db5-4566-9c59-b63f7ac6e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Volume 498976c7-3449-45c9-b586-cf08b6333411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498976c7-3449-45c9-b586-cf08b6333411', 'volume_size': 1}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1704930480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498976c7-3449-45c9-b586-cf08b6333411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bf95f146ba4b5fa9b46ff46d064440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:24Z,use_quota=True,user_id='3dc0b0f0b3ed497bbd8381a98675ec57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Creating volume 498976c7-3449-45c9-b586-cf08b6333411 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:52:23 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:52:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:23 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 1073741824
Sep 25 11:52:23 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:24 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 1073741824" returned: 0 in 0.534s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:24 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411
Sep 25 11:52:24 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:24 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eb9b71-6de5-4e14-9896-54a7c6b5239a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f085560-4db5-4566-9c59-b63f7ac6e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498976c7-3449-45c9-b586-cf08b6333411', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8ccf8a-2bf2-4db3-9455-aa506468d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Volume volume-498976c7-3449-45c9-b586-cf08b6333411 (498976c7-3449-45c9-b586-cf08b6333411): created successfully
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8ccf8a-2bf2-4db3-9455-aa506468d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Flow 'volume_create_manager' (ce18551a-d3eb-4de4-be6e-7f670863f561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-71323df1-51fa-470e-acfa-4da80c068783 tempest-TestMinimumBasicScenario-709248213 None] Created volume successfully.
Sep 25 11:52:24 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb
Sep 25 11:52:24 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:25 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb" returned: 0 in 0.506s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:25 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb
Sep 25 11:52:25 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:25 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-81091fce-5d01-4067-ac2f-a843c18491eb" returned: 0 in 0.366s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-81091fce-5d01-4067-ac2f-a843c18491eb" released by "delete_volume" :: held 0.957s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f09bff5-bb9b-4dd3-bd0b-2088a44d98f9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:25 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd
Sep 25 11:52:25 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:26 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:26 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd
Sep 25 11:52:26 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:26 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" returned: 0 in 0.351s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-ac13a8bd-3710-4e93-9c2e-8f71f69630bd" released by "delete_volume" :: held 0.957s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Created reservations ['aafe65ef-aedd-4462-a3c9-45bc7b5ef4dd'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:26 devstack cinder-volume[87358]: WARNING cinder.quota [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-747753255 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-747753255, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Created reservations ['e00145df-55db-4518-8218-ac4934041a8e', '67efc432-e743-403b-bdf7-e2800ada81f7', '8b10426c-6249-494a-a700-76931a0c4d9e', '61ca7b24-8e59-4594-87a6-d2478ad08871'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-2da6c150-4b86-4b5b-b767-70fd797fa99c req-123865c7-e2a3-4602-9824-e765f678ec2d tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-2da6c150-4b86-4b5b-b767-70fd797fa99c req-123865c7-e2a3-4602-9824-e765f678ec2d tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-2da6c150-4b86-4b5b-b767-70fd797fa99c req-123865c7-e2a3-4602-9824-e765f678ec2d tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-2da6c150-4b86-4b5b-b767-70fd797fa99c req-123865c7-e2a3-4602-9824-e765f678ec2d tempest-TestMinimumBasicScenario-709248213 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-498976c7-3449-45c9-b586-cf08b6333411', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f7d3aa8-84d3-4547-a3df-1a9af641e9cd', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:52:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-2da6c150-4b86-4b5b-b767-70fd797fa99c req-123865c7-e2a3-4602-9824-e765f678ec2d tempest-TestMinimumBasicScenario-709248213 None] attachment_update completed successfully.
Sep 25 11:52:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Created reservations ['2abab8d6-678f-4e46-94e9-bfb1af688dc3', '8feb9a21-98fe-4657-9b38-0b66dfaef6a1', '6fe0a827-89d9-44ba-81e4-07960786288c', 'c96ff96c-9f0b-42a0-b61e-091bdf19b02b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:27 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:52:27 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:27 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.401s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:52:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ffdcf5d2-f420-469f-8d82-208dd848376a tempest-GroupSnapshotsTest-994378603 None] Delete group completed successfully.
Sep 25 11:52:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-db9d4548-a1d4-4408-ae14-c6d93a621585 tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-1722868438: creating
Sep 25 11:52:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-db9d4548-a1d4-4408-ae14-c6d93a621585 tempest-GroupSnapshotsTest-994378603 None] Group tempest-GroupSnapshotsTest-Group-1722868438: created successfully
Sep 25 11:52:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-db9d4548-a1d4-4408-ae14-c6d93a621585 tempest-GroupSnapshotsTest-994378603 None] Create group completed successfully.
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (96079c97-ea0f-4219-96d1-1b560014ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5d05c1-8e20-470f-9024-3848bea57f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5d05c1-8e20-470f-9024-3848bea57f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556448334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7fc6e34-c380-447d-bc85-791d2187179d,host='devstack@QuobyteHD#QuobyteHD',id=245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:31Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742a0479-d324-4f36-b339-a365dd52c7b4),volume_type_id=742a0479-d324-4f36-b339-a365dd52c7b4)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f9b07e-8dec-4710-a381-0a2786efc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f9b07e-8dec-4710-a381-0a2786efc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6642bb3b-27cb-42d8-be27-fe515d4c0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6642bb3b-27cb-42d8-be27-fe515d4c0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8', 'volume_name': 'volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086dcaec-b595-4536-b7de-ce63f8581308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086dcaec-b595-4536-b7de-ce63f8581308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c6520-b1fa-49bc-a1b2-f46951a54bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Volume 245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8', 'volume_size': 1}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f7fc6e34-c380-447d-bc85-791d2187179d,created_at=2026-09-25T09:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556448334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7fc6e34-c380-447d-bc85-791d2187179d,host='devstack@QuobyteHD#QuobyteHD',id=245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a86b4efaef444f8f9061d193e0337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:31Z,use_quota=True,user_id='3d79bef94c164d829ad27c4d63d78aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742a0479-d324-4f36-b339-a365dd52c7b4),volume_type_id=742a0479-d324-4f36-b339-a365dd52c7b4)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Creating volume 245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:52:31 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:31 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 1073741824
Sep 25 11:52:31 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:31 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 1073741824" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:31 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8
Sep 25 11:52:31 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:32 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" returned: 0 in 0.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c6520-b1fa-49bc-a1b2-f46951a54bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d573fed-5480-4555-85a9-aea78561dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:52:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Volume volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 (245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8): created successfully
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d573fed-5480-4555-85a9-aea78561dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:52:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Flow 'volume_create_manager' (96079c97-ea0f-4219-96d1-1b560014ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:52:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0a780b7e-3612-431d-abfb-7dbfed5ddad9 tempest-GroupSnapshotsTest-994378603 None] Created volume successfully.
Sep 25 11:52:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] GroupSnapshot d52f5526-f043-4b53-a7c8-d4528957a21a: creating.
Sep 25 11:52:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Group snapshot d52f5526-f043-4b53-a7c8-d4528957a21a: creating. {{(pid=87358) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 11:52:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Creating offline snapshot b0c0613e-c7b8-49a9-8404-5274d1f81c24 of volume 245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:52:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c347e9b-84ed-4570-85bc-9a5c09dcc487]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:34 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8
Sep 25 11:52:34 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:34 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" returned: 0 in 0.560s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:34 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 1G
Sep 25 11:52:34 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:35 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 1G" returned: 0 in 0.735s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:35 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24
Sep 25 11:52:35 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:35 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24" returned: 0 in 0.406s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:35 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:35 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24
Sep 25 11:52:35 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:36 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:36 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info
Sep 25 11:52:36 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:36 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info" returned: 0 in 0.306s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:36 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:36 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info
Sep 25 11:52:36 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:36 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.info" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5ce14ec5-bcb4-491a-ab8c-b581c1383d2c tempest-GroupSnapshotsTest-994378603 None] group_snapshot d52f5526-f043-4b53-a7c8-d4528957a21a: created successfully
Sep 25 11:52:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] group_snapshot d52f5526-f043-4b53-a7c8-d4528957a21a: deleting
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] group_snapshot d52f5526-f043-4b53-a7c8-d4528957a21a: deleting {{(pid=87358) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-b0c0613e-c7b8-49a9-8404-5274d1f81c24" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-b0c0613e-c7b8-49a9-8404-5274d1f81c24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Deleting offline snapshot b0c0613e-c7b8-49a9-8404-5274d1f81c24 of volume 245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] snapshot_file for this snap is: volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eab159-de96-427d-892e-955c0deb444d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:37 devstack sudo[104909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24
Sep 25 11:52:37 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:38 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e8664-0b84-4a52-a68e-7937efeeb826]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:38 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8
Sep 25 11:52:38 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:38 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" returned: 0 in 0.391s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:38 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24
Sep 25 11:52:38 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:38 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24" returned: 0 in 0.470s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:38 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24
Sep 25 11:52:38 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:39 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8.b0c0613e-c7b8-49a9-8404-5274d1f81c24" returned: 0 in 0.340s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-b0c0613e-c7b8-49a9-8404-5274d1f81c24" released by "_delete_snapshot" :: held 1.810s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" released by "delete_snapshot" :: held 1.837s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:39 devstack cinder-volume[87358]: WARNING cinder.quota [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1554610479 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1554610479, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:39 devstack cinder-volume[87358]: WARNING cinder.quota [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1554610479 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1554610479, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:39 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['708eed1b-41dd-4d1f-a4cf-9fcebb7285be', 'e22fb03f-bf56-4282-b198-82967f9b3cba', 'd1a88553-5cef-4aa6-9f0a-6d12e8a735ce', '593b7f21-b9e9-41c8-8ec8-8a9993458dee'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e5ce0759-adc8-4a93-8dc0-183734d5bae0 tempest-GroupSnapshotsTest-994378603 None] group_snapshot d52f5526-f043-4b53-a7c8-d4528957a21a: deleted successfully
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc56b3f4-b6da-4e67-a6cc-10736f411d9a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:40 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8
Sep 25 11:52:40 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:40 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:40 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8
Sep 25 11:52:40 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:40 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Lock "cinder-quobyte-245b2a7d-52bb-4b0a-a32d-0b89f2f92ea8" released by "delete_volume" :: held 0.733s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:52:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['eb4b4046-d3f6-49d0-b8a3-42136f43c399'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:41 devstack cinder-volume[87358]: WARNING cinder.quota [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1554610479 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1554610479, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Created reservations ['796ce6b6-7120-4803-b710-924ab754ec95', '1999c55c-274b-422d-9c40-4aab23710997', '3b5f7409-e3b3-44df-af8f-8f9cd0bcbe17', '14d5822b-c1bf-40aa-aea7-f64d01f1a86e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:41 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:52:41 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:41 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.292s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:41 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:52:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-dbbaf026-fc2d-4d09-a86c-1cce2c232035 tempest-GroupSnapshotsTest-994378603 None] Delete group completed successfully.
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=62,cinder:SELECT=65,cinder:INSERT=15 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=62,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:52:51 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:52:51 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:52:51 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:52:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:53:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-c80043b1-b67b-483f-8cae-3d3a57c7dc00 req-6956f8af-d04b-4d50-b032-f639df783800 tempest-TestMinimumBasicScenario-709248213 None] Terminate volume connection completed successfully.
Sep 25 11:53:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-c80043b1-b67b-483f-8cae-3d3a57c7dc00 req-6956f8af-d04b-4d50-b032-f639df783800 tempest-TestMinimumBasicScenario-709248213 None] Deleting attachment 1f7d3aa8-84d3-4547-a3df-1a9af641e9cd. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "cinder-498976c7-3449-45c9-b586-cf08b6333411-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "cinder-498976c7-3449-45c9-b586-cf08b6333411-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "cinder-quobyte-498976c7-3449-45c9-b586-cf08b6333411" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "cinder-quobyte-498976c7-3449-45c9-b586-cf08b6333411" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebf08cd-e8fe-4569-b800-1e0ad2dc7f60]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:24 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411
Sep 25 11:53:24 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:24 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411" returned: 0 in 0.501s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:24 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411
Sep 25 11:53:24 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:25 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-498976c7-3449-45c9-b586-cf08b6333411" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "cinder-quobyte-498976c7-3449-45c9-b586-cf08b6333411" released by "delete_volume" :: held 0.956s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Created reservations ['4081183e-30d7-4c14-997c-0f5a21ded080', 'aba601c3-12fa-4a56-8e2f-bfc3066fde4f', 'a3c3dc5b-1a30-45c5-863a-103160f5ab36', 'd2a0b82b-2d9a-41b9-917c-de4bc54622f7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:25 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:53:25 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:25 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.450s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:25 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:53:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Deleted volume successfully.
Sep 25 11:53:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9eb40fdd-6eb5-4571-b3ff-2ed6aec755e8 tempest-TestMinimumBasicScenario-709248213 None] Lock "cinder-498976c7-3449-45c9-b586-cf08b6333411-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (638e86ec-a97a-43ee-83a6-e82970ae66b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2729cb8-2c85-4cad-8500-ccd92bc6280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2729cb8-2c85-4cad-8500-ccd92bc6280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020226786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73171fc-891d-4c35-9af0-478c4219a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:34Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c4ebb9-f16a-4136-b0aa-3d7ca867cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c4ebb9-f16a-4136-b0aa-3d7ca867cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2a706e-06e5-4de2-a6d8-a5e40b30ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2a706e-06e5-4de2-a6d8-a5e40b30ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73171fc-891d-4c35-9af0-478c4219a9de', 'volume_name': 'volume-e73171fc-891d-4c35-9af0-478c4219a9de', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69b5100-1a65-4f93-b29c-a11eff0f7a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69b5100-1a65-4f93-b29c-a11eff0f7a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b422356-1daf-400f-8dbe-52d30a2952e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:34 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Volume e73171fc-891d-4c35-9af0-478c4219a9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73171fc-891d-4c35-9af0-478c4219a9de', 'volume_size': 1}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020226786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73171fc-891d-4c35-9af0-478c4219a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:34Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Creating volume e73171fc-891d-4c35-9af0-478c4219a9de {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:53:34 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:53:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:34 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de 1073741824
Sep 25 11:53:34 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:35 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de 1073741824" returned: 0 in 0.619s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:35 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de
Sep 25 11:53:35 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:35 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b422356-1daf-400f-8dbe-52d30a2952e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73171fc-891d-4c35-9af0-478c4219a9de', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b2e67c-11d7-48ec-a10d-ced080526206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Volume volume-e73171fc-891d-4c35-9af0-478c4219a9de (e73171fc-891d-4c35-9af0-478c4219a9de): created successfully
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b2e67c-11d7-48ec-a10d-ced080526206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (638e86ec-a97a-43ee-83a6-e82970ae66b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c56af365-e55a-4613-99fc-a2fe6a4ae43b tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:53:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb0f8edf-21f8-4d1d-b354-164aa5eca34b tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de" by "attach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb0f8edf-21f8-4d1d-b354-164aa5eca34b tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de" acquired by "attach_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fb0f8edf-21f8-4d1d-b354-164aa5eca34b tempest-VolumesActionsTest-1840270821 None] Attaching volume e73171fc-891d-4c35-9af0-478c4219a9de to instance 377fc409-8979-4ce8-917f-5b7d6ec36f12 at mountpoint /dev/vdb on host None.
Sep 25 11:53:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fb0f8edf-21f8-4d1d-b354-164aa5eca34b tempest-VolumesActionsTest-1840270821 None] Attach volume completed successfully.
Sep 25 11:53:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fb0f8edf-21f8-4d1d-b354-164aa5eca34b tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de" released by "attach_volume" :: held 0.231s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Terminate volume connection completed successfully.
Sep 25 11:53:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" by "detach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Detaching volume e73171fc-891d-4c35-9af0-478c4219a9de from instance 377fc409-8979-4ce8-917f-5b7d6ec36f12.
Sep 25 11:53:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Detach volume completed successfully.
Sep 25 11:53:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d9dc86e-a22f-48af-9766-8e4e45b46d8b tempest-VolumesActionsTest-1354551222 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbc436f3-49cf-4126-a909-ebf69c548f8d tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" by "detach_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbc436f3-49cf-4126-a909-ebf69c548f8d tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bbc436f3-49cf-4126-a909-ebf69c548f8d tempest-VolumesActionsTest-1840270821 None] Volume detach called, but volume not attached.
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bbc436f3-49cf-4126-a909-ebf69c548f8d tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-quobyte-e73171fc-891d-4c35-9af0-478c4219a9de" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "cinder-quobyte-e73171fc-891d-4c35-9af0-478c4219a9de" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d54fc4d-4e82-4b6e-815f-52b792bc356f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:38 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de
Sep 25 11:53:38 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:38 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:39 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de
Sep 25 11:53:39 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:39 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e73171fc-891d-4c35-9af0-478c4219a9de" returned: 0 in 0.311s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "cinder-quobyte-e73171fc-891d-4c35-9af0-478c4219a9de" released by "delete_volume" :: held 0.828s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Created reservations ['8dd469e8-89d6-4ef3-a3eb-be7c7f06164f', '12a0b099-d75c-4f19-889a-718fb60906a9', '9795d6de-9aae-4d04-9141-ced8e0b891aa', '2dc6221c-a1bf-4dbb-b8b8-3a01a0d62076'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:39 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:53:39 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:39 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:39 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:53:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Deleted volume successfully.
Sep 25 11:53:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-1763a1dd-1550-4c40-92a5-d34ed0e0b5ba tempest-VolumesActionsTest-1840270821 None] Lock "cinder-e73171fc-891d-4c35-9af0-478c4219a9de-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (ea5ad8de-e0bb-4924-91da-0839514b4d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7c81e5-bb33-42a0-9779-b948f563420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7c81e5-bb33-42a0-9779-b948f563420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870432130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1110aada-9945-4664-ba10-f8021ec9c5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:44Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe19e04-7db6-4418-a3bd-eaba3b4dc505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe19e04-7db6-4418-a3bd-eaba3b4dc505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515a699f-ba9d-4df8-b6ca-c20dd330d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515a699f-ba9d-4df8-b6ca-c20dd330d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1110aada-9945-4664-ba10-f8021ec9c5d6', 'volume_name': 'volume-1110aada-9945-4664-ba10-f8021ec9c5d6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11708e80-d2a0-4314-911a-f70810098838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11708e80-d2a0-4314-911a-f70810098838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5045d67-cd52-4517-95e4-6ab662d4a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:43 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Volume 1110aada-9945-4664-ba10-f8021ec9c5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1110aada-9945-4664-ba10-f8021ec9c5d6', 'volume_size': 1}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870432130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1110aada-9945-4664-ba10-f8021ec9c5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:44Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Creating volume 1110aada-9945-4664-ba10-f8021ec9c5d6 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:53:43 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:53:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:43 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 1073741824
Sep 25 11:53:43 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:44 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 1073741824" returned: 0 in 0.542s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:44 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6
Sep 25 11:53:44 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:44 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5045d67-cd52-4517-95e4-6ab662d4a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1110aada-9945-4664-ba10-f8021ec9c5d6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5687ac6-29ad-4fcb-a518-c264cf0cddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:44 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Volume volume-1110aada-9945-4664-ba10-f8021ec9c5d6 (1110aada-9945-4664-ba10-f8021ec9c5d6): created successfully
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5687ac6-29ad-4fcb-a518-c264cf0cddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (ea5ad8de-e0bb-4924-91da-0839514b4d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-01087e05-8d79-41cd-bde6-0542cd738b73 tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-1110aada-9945-4664-ba10-f8021ec9c5d6-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-1110aada-9945-4664-ba10-f8021ec9c5d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-quobyte-1110aada-9945-4664-ba10-f8021ec9c5d6" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-1110aada-9945-4664-ba10-f8021ec9c5d6" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ba16b-751b-450b-b9f3-7211ee541a36]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:46 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6
Sep 25 11:53:46 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:46 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:46 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6
Sep 25 11:53:46 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:46 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1110aada-9945-4664-ba10-f8021ec9c5d6" returned: 0 in 0.266s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-1110aada-9945-4664-ba10-f8021ec9c5d6" released by "delete_volume" :: held 0.781s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:46 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Created reservations ['dc4d491c-5b6a-4128-82b6-63c1d6230e0e', '8d95626f-84e4-4864-aee1-06568e21fb3e', '2eb04bb2-b983-4b66-9927-dee911bc0b87', '12cfc57b-5c03-49b8-a268-63fe34a7e34f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:47 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:53:47 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:47 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:53:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Deleted volume successfully.
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0b242e5a-67e7-4d59-ac6a-341301614479 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-1110aada-9945-4664-ba10-f8021ec9c5d6-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (f9050881-ff78-41d4-9c87-4deff90f9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7087a9-ba14-4cc8-aa7f-9bbe2ed54136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7087a9-ba14-4cc8-aa7f-9bbe2ed54136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412799333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77837758-3f1a-47a8-8799-9d72cc628484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:48Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c63a87-d005-44ce-a130-79e52da0931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c63a87-d005-44ce-a130-79e52da0931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cc1dc5-0314-48d2-bc07-ff80b63c5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cc1dc5-0314-48d2-bc07-ff80b63c5eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77837758-3f1a-47a8-8799-9d72cc628484', 'volume_name': 'volume-77837758-3f1a-47a8-8799-9d72cc628484', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7529e939-52b4-4d7a-a7c6-e37ffe125d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7529e939-52b4-4d7a-a7c6-e37ffe125d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1bd611-7668-42f6-8137-8da2cece6df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Volume 77837758-3f1a-47a8-8799-9d72cc628484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77837758-3f1a-47a8-8799-9d72cc628484', 'volume_size': 1}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412799333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77837758-3f1a-47a8-8799-9d72cc628484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:48Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Creating volume 77837758-3f1a-47a8-8799-9d72cc628484 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:53:48 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:48 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 1073741824
Sep 25 11:53:48 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:48 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 1073741824" returned: 0 in 0.543s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:48 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484
Sep 25 11:53:48 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:48 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:53:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1bd611-7668-42f6-8137-8da2cece6df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77837758-3f1a-47a8-8799-9d72cc628484', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22344ab8-647a-45a3-ad7a-43ae788e7bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Volume volume-77837758-3f1a-47a8-8799-9d72cc628484 (77837758-3f1a-47a8-8799-9d72cc628484): created successfully
Sep 25 11:53:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22344ab8-647a-45a3-ad7a-43ae788e7bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (f9050881-ff78-41d4-9c87-4deff90f9da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ef24e8ae-5139-49cd-972b-229cf7031705 tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-77837758-3f1a-47a8-8799-9d72cc628484-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-77837758-3f1a-47a8-8799-9d72cc628484-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-quobyte-77837758-3f1a-47a8-8799-9d72cc628484" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-77837758-3f1a-47a8-8799-9d72cc628484" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d174d87-8c2c-496e-b82c-ac8b0d24a1f1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:50 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484
Sep 25 11:53:50 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:50 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484" returned: 0 in 0.428s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:50 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484
Sep 25 11:53:50 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:51 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-77837758-3f1a-47a8-8799-9d72cc628484" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-77837758-3f1a-47a8-8799-9d72cc628484" released by "delete_volume" :: held 0.785s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Created reservations ['f5e147de-ba57-40e2-8c4b-e6d3b0427b51', '137335ab-3aa8-4231-9f18-803c57499ba8', '5e82cab1-a34b-4d6d-8743-6d8b662f871c', '0640be93-c1eb-4820-8478-8cdd32ac2fbe'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:51 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:53:51 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:53:51 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.298s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:53:51 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Deleted volume successfully.
Sep 25 11:53:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-569c8c95-aac3-4693-8b4a-e51a60ee3af5 tempest-VolumesActionsTest-1354551222 None] Lock "cinder-77837758-3f1a-47a8-8799-9d72cc628484-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (f4e3ee4f-915a-4bd4-8686-334b2a629bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d283b1b-63ee-4aad-ba36-2172f2c7ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d283b1b-63ee-4aad-ba36-2172f2c7ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89409260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fddd85a-92ba-4539-a696-b2dda1c20027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:52Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f95629-17ef-4bb4-a53c-c81248f94326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f95629-17ef-4bb4-a53c-c81248f94326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30994d01-2fb0-4406-b8fa-527f85794b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30994d01-2fb0-4406-b8fa-527f85794b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fddd85a-92ba-4539-a696-b2dda1c20027', 'volume_name': 'volume-2fddd85a-92ba-4539-a696-b2dda1c20027', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbd3ee3-8b52-4f73-b680-9c2437ecaed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbd3ee3-8b52-4f73-b680-9c2437ecaed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d8b6d9-19b4-4875-b01e-579aada3083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:52 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Volume 2fddd85a-92ba-4539-a696-b2dda1c20027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fddd85a-92ba-4539-a696-b2dda1c20027', 'volume_size': 1}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89409260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fddd85a-92ba-4539-a696-b2dda1c20027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:52Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Creating volume 2fddd85a-92ba-4539-a696-b2dda1c20027 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:53:52 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:52 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 1073741824
Sep 25 11:53:52 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:52 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 1073741824" returned: 0 in 0.514s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:52 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027
Sep 25 11:53:52 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:53 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027" returned: 0 in 0.471s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d8b6d9-19b4-4875-b01e-579aada3083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fddd85a-92ba-4539-a696-b2dda1c20027', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348b428d-e876-415f-8ae0-becae136df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Volume volume-2fddd85a-92ba-4539-a696-b2dda1c20027 (2fddd85a-92ba-4539-a696-b2dda1c20027): created successfully
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348b428d-e876-415f-8ae0-becae136df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (f4e3ee4f-915a-4bd4-8686-334b2a629bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d9c6fe83-d1ab-4f2f-aa2b-b913db842dc9 tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-2fddd85a-92ba-4539-a696-b2dda1c20027-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-2fddd85a-92ba-4539-a696-b2dda1c20027-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-quobyte-2fddd85a-92ba-4539-a696-b2dda1c20027" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-2fddd85a-92ba-4539-a696-b2dda1c20027" acquired by "delete_volume" :: waited 0.063s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b4549-cec4-4b00-b165-fffb0ebb81f4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:54 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027
Sep 25 11:53:54 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:55 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027" returned: 0 in 0.636s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:55 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027
Sep 25 11:53:55 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:55 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-2fddd85a-92ba-4539-a696-b2dda1c20027" returned: 0 in 0.405s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-2fddd85a-92ba-4539-a696-b2dda1c20027" released by "delete_volume" :: held 1.155s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Created reservations ['027d0419-ff79-4d34-9825-1b022f74d1c5', '6f67a797-e14c-4057-8dba-0edcb3f64fd6', '60b18fe5-2239-42fc-83a1-753acd65a758', '016970fb-bf72-42ae-97e3-6b4eb4f409fc'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:55 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:53:55 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:56 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.320s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:56 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:53:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Deleted volume successfully.
Sep 25 11:53:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6f323f7c-ce41-4b6b-8eab-fdb965e9a14c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-2fddd85a-92ba-4539-a696-b2dda1c20027-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (a6577905-aac8-40eb-9295-5b00c6b58c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91ee741-4a22-4d46-8073-a759d0378dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91ee741-4a22-4d46-8073-a759d0378dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318943157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc985f5-89bb-4688-8577-e8dcd5437dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:57Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e7e3bb-6e95-4f0f-8624-4b37b17e61a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e7e3bb-6e95-4f0f-8624-4b37b17e61a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbe4f2-dafa-44cd-ab7b-8b63df18b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbe4f2-dafa-44cd-ab7b-8b63df18b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc985f5-89bb-4688-8577-e8dcd5437dd3', 'volume_name': 'volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d9112-4f9a-4d0d-8715-50a25937bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d9112-4f9a-4d0d-8715-50a25937bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4873aa5b-f975-4173-b99b-40cc83ac7349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Volume ccc985f5-89bb-4688-8577-e8dcd5437dd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3', 'volume_size': 1}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318943157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc985f5-89bb-4688-8577-e8dcd5437dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:57Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Creating volume ccc985f5-89bb-4688-8577-e8dcd5437dd3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:53:57 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:53:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:57 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 1073741824
Sep 25 11:53:57 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:58 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 1073741824" returned: 0 in 0.721s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:53:58 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3
Sep 25 11:53:58 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:53:58 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3" returned: 0 in 0.310s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4873aa5b-f975-4173-b99b-40cc83ac7349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f4a3d-5213-40ac-bd74-326a1d47f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:53:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Volume volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 (ccc985f5-89bb-4688-8577-e8dcd5437dd3): created successfully
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f4a3d-5213-40ac-bd74-326a1d47f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:53:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (a6577905-aac8-40eb-9295-5b00c6b58c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:53:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-00d025af-246c-46f9-a176-58698ec18247 tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-ccc985f5-89bb-4688-8577-e8dcd5437dd3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-ccc985f5-89bb-4688-8577-e8dcd5437dd3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "cinder-quobyte-ccc985f5-89bb-4688-8577-e8dcd5437dd3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-ccc985f5-89bb-4688-8577-e8dcd5437dd3" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc708c0d-1a81-4685-b3f7-cfdb2819f11e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:53:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:00 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3
Sep 25 11:54:00 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:00 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3" returned: 0 in 0.437s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:00 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3
Sep 25 11:54:00 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:00 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ccc985f5-89bb-4688-8577-e8dcd5437dd3" returned: 0 in 0.283s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-quobyte-ccc985f5-89bb-4688-8577-e8dcd5437dd3" released by "delete_volume" :: held 0.770s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Created reservations ['dc77016b-dd93-434c-87d6-255726ebacd3', '9b930d9d-ebda-4ff1-a03e-ca6fca705f6f', 'a4697ece-cd85-4a9e-abef-8fdc2a14d1f9', '0adf9274-df76-4722-8fef-7aa5e14acae6'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:00 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:54:00 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:01 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:54:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Deleted volume successfully.
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-60fd21e1-ed69-47e8-806d-32224ec3728c tempest-VolumesActionsTest-1354551222 None] Lock "cinder-ccc985f5-89bb-4688-8577-e8dcd5437dd3-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (9a190b13-61de-48e0-bd6c-b4fa287eb1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240429e2-ee82-4751-a6e7-2685d76b9cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240429e2-ee82-4751-a6e7-2685d76b9cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551742302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c0dae8-31e7-45e5-9491-76d92070937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:02Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d347b3d0-ea15-417a-9a2b-c5b619efbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d347b3d0-ea15-417a-9a2b-c5b619efbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1c4b6c-5817-4f98-baa4-adc24178592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1c4b6c-5817-4f98-baa4-adc24178592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c0dae8-31e7-45e5-9491-76d92070937d', 'volume_name': 'volume-65c0dae8-31e7-45e5-9491-76d92070937d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cad6de9-6cfb-4331-8cd0-5b3e9ce0be93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cad6de9-6cfb-4331-8cd0-5b3e9ce0be93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc3c0e3-c5ab-4535-962f-f1f26d437aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:01 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Volume 65c0dae8-31e7-45e5-9491-76d92070937d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c0dae8-31e7-45e5-9491-76d92070937d', 'volume_size': 1}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551742302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c0dae8-31e7-45e5-9491-76d92070937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68134b12f14a485eb96634d73fd1d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:02Z,use_quota=True,user_id='6bcbe27e915e41fd9ed95e59e8af627d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Creating volume 65c0dae8-31e7-45e5-9491-76d92070937d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:01 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:01 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d 1073741824
Sep 25 11:54:01 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:02 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d 1073741824" returned: 0 in 0.665s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:02 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d
Sep 25 11:54:02 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:02 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc3c0e3-c5ab-4535-962f-f1f26d437aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c0dae8-31e7-45e5-9491-76d92070937d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8913a30d-fd59-4ea1-8ecb-e03b9bf531fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:02 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Volume volume-65c0dae8-31e7-45e5-9491-76d92070937d (65c0dae8-31e7-45e5-9491-76d92070937d): created successfully
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8913a30d-fd59-4ea1-8ecb-e03b9bf531fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Flow 'volume_create_manager' (9a190b13-61de-48e0-bd6c-b4fa287eb1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2431a396-ac63-4a7e-8e50-9a7684a74c3c tempest-VolumesActionsTest-1840270821 None] Created volume successfully.
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-65c0dae8-31e7-45e5-9491-76d92070937d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "cinder-65c0dae8-31e7-45e5-9491-76d92070937d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "cinder-quobyte-65c0dae8-31e7-45e5-9491-76d92070937d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "cinder-quobyte-65c0dae8-31e7-45e5-9491-76d92070937d" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea18fef-a234-4704-abfa-0a4f099a4d5e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:04 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d
Sep 25 11:54:04 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:05 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:05 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d
Sep 25 11:54:05 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:05 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-65c0dae8-31e7-45e5-9491-76d92070937d" returned: 0 in 0.283s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "cinder-quobyte-65c0dae8-31e7-45e5-9491-76d92070937d" released by "delete_volume" :: held 0.781s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Created reservations ['9c756299-1d49-4601-bc84-795000d4f089', 'be8e06f6-b2fa-400c-9ac1-8583593b16f2', '0e4bd0f8-8aa9-4bd9-b03c-5e3f07f8dd4a', '5f6f2ec8-bd2a-45d7-a7a3-02c39ac25254'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:05 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:54:05 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:06 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:06 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:54:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Deleted volume successfully.
Sep 25 11:54:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bc289094-4827-4456-8187-d5c97180b3a6 tempest-VolumesActionsTest-1840270821 None] Lock "cinder-65c0dae8-31e7-45e5-9491-76d92070937d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:15 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=63,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=48,cinder:INSERT=20,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Flow 'volume_create_manager' (8b644102-826b-4c04-a20b-476f21772349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705ec00c-7614-4116-aa31-a6c55036a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705ec00c-7614-4116-aa31-a6c55036a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-81848199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb4da2d-85a5-425b-a651-1d120a67f9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b2f0606b60473d91d7ff5d31b8641a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:16Z,use_quota=True,user_id='967c3d0d4058468fb418ff453d198444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da8e68e-cfb9-4d8b-bee7-4549f5f9d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da8e68e-cfb9-4d8b-bee7-4549f5f9d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b301f227-1aff-416e-9e4c-54737186157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b301f227-1aff-416e-9e4c-54737186157f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb4da2d-85a5-425b-a651-1d120a67f9c6', 'volume_name': 'volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbece09-23d3-42ef-9a1f-835ed6dc263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbece09-23d3-42ef-9a1f-835ed6dc263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795a2cc-996a-4f10-a13d-845dfcc44154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume 9cb4da2d-85a5-425b-a651-1d120a67f9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6', 'volume_size': 1}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-81848199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb4da2d-85a5-425b-a651-1d120a67f9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b2f0606b60473d91d7ff5d31b8641a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:16Z,use_quota=True,user_id='967c3d0d4058468fb418ff453d198444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Creating volume 9cb4da2d-85a5-425b-a651-1d120a67f9c6 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:16 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:16 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 1073741824
Sep 25 11:54:16 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Flow 'volume_create_manager' (07804729-547c-4ca3-bd65-327ea183b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122907c8-1e50-4a71-854a-3415f3a84cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122907c8-1e50-4a71-854a-3415f3a84cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1022741476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6204c033-a77e-4d1c-87c2-03b73be9717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b2f0606b60473d91d7ff5d31b8641a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:17Z,use_quota=True,user_id='967c3d0d4058468fb418ff453d198444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13b7366-a172-4a85-bb11-bf048ad94c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13b7366-a172-4a85-bb11-bf048ad94c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e57af4e-c9eb-4852-9ce1-d52e25e36943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e57af4e-c9eb-4852-9ce1-d52e25e36943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6204c033-a77e-4d1c-87c2-03b73be9717e', 'volume_name': 'volume-6204c033-a77e-4d1c-87c2-03b73be9717e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e57fd8-e661-4ef5-8fcc-ef84c6d2b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e57fd8-e661-4ef5-8fcc-ef84c6d2b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd130c1-cea6-45dd-b6f3-e8f7d7497a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:16 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume 6204c033-a77e-4d1c-87c2-03b73be9717e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6204c033-a77e-4d1c-87c2-03b73be9717e', 'volume_size': 1}
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:16 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 1073741824" returned: 0 in 0.713s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:17 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6
Sep 25 11:54:17 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:17 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6" returned: 0 in 0.376s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1022741476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6204c033-a77e-4d1c-87c2-03b73be9717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b2f0606b60473d91d7ff5d31b8641a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:17Z,use_quota=True,user_id='967c3d0d4058468fb418ff453d198444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Creating volume 6204c033-a77e-4d1c-87c2-03b73be9717e {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:17 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795a2cc-996a-4f10-a13d-845dfcc44154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7843831-c854-49df-b5c1-74c5287e2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:17 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e 1073741824
Sep 25 11:54:17 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:17 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 (9cb4da2d-85a5-425b-a651-1d120a67f9c6): created successfully
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7843831-c854-49df-b5c1-74c5287e2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Flow 'volume_create_manager' (8b644102-826b-4c04-a20b-476f21772349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-97ec9fd5-73df-41b8-8812-80fb67748333 tempest-TestServerVolumeAttachmentScenario-637625990 None] Created volume successfully.
Sep 25 11:54:18 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e 1073741824" returned: 0 in 0.653s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:18 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e
Sep 25 11:54:18 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:18 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e" returned: 0 in 0.534s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd130c1-cea6-45dd-b6f3-e8f7d7497a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6204c033-a77e-4d1c-87c2-03b73be9717e', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d668a51-0cea-4ada-8dcf-78e51838e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Volume volume-6204c033-a77e-4d1c-87c2-03b73be9717e (6204c033-a77e-4d1c-87c2-03b73be9717e): created successfully
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d668a51-0cea-4ada-8dcf-78e51838e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Flow 'volume_create_manager' (07804729-547c-4ca3-bd65-327ea183b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0109260e-59c3-4d0a-a660-bd6a27a26205 tempest-TestServerVolumeAttachmentScenario-637625990 None] Created volume successfully.
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Flow 'volume_create_manager' (22ba87c4-f927-4d0f-9c73-bc8bbfe3accd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718ec4f9-fe29-4560-a5fe-967093fc9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718ec4f9-fe29-4560-a5fe-967093fc9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2119665960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d349f83d-8e0f-4924-a437-ee1214d33665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b83340c17414f5bb3a721f4c49192c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='4b268ecd8721498cadd58ba614df42a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe8ed01-c108-46d1-9dad-521ab38e52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe8ed01-c108-46d1-9dad-521ab38e52e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132935af-d882-4817-b4f0-a3b51b12807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132935af-d882-4817-b4f0-a3b51b12807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd349f83d-8e0f-4924-a437-ee1214d33665', 'volume_name': 'volume-d349f83d-8e0f-4924-a437-ee1214d33665', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75a0fb-8e0b-49fb-99f4-c2464f6a035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75a0fb-8e0b-49fb-99f4-c2464f6a035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2bd3da-bfcb-479e-9903-95ebc5fa10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Volume d349f83d-8e0f-4924-a437-ee1214d33665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d349f83d-8e0f-4924-a437-ee1214d33665', 'volume_size': 1}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2119665960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d349f83d-8e0f-4924-a437-ee1214d33665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b83340c17414f5bb3a721f4c49192c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='4b268ecd8721498cadd58ba614df42a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Creating volume d349f83d-8e0f-4924-a437-ee1214d33665 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:27 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:27 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 1073741824
Sep 25 11:54:27 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:27 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 1073741824" returned: 0 in 0.566s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:27 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665
Sep 25 11:54:27 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:28 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665" returned: 0 in 0.287s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2bd3da-bfcb-479e-9903-95ebc5fa10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d349f83d-8e0f-4924-a437-ee1214d33665', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25cf962-752d-4794-9032-649aa8962a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Volume volume-d349f83d-8e0f-4924-a437-ee1214d33665 (d349f83d-8e0f-4924-a437-ee1214d33665): created successfully
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25cf962-752d-4794-9032-649aa8962a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Flow 'volume_create_manager' (22ba87c4-f927-4d0f-9c73-bc8bbfe3accd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-60f4884e-f24a-43e7-8e2e-1b77e2fe1244 tempest-AbsoluteLimitsTests-1520842333 None] Created volume successfully.
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Acquiring lock "cinder-d349f83d-8e0f-4924-a437-ee1214d33665-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "cinder-d349f83d-8e0f-4924-a437-ee1214d33665-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Acquiring lock "cinder-quobyte-d349f83d-8e0f-4924-a437-ee1214d33665" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "cinder-quobyte-d349f83d-8e0f-4924-a437-ee1214d33665" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c16d81-7641-48bc-a90c-44665f654dfc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:29 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665
Sep 25 11:54:29 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:29 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665" returned: 0 in 0.432s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:29 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665
Sep 25 11:54:29 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:30 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d349f83d-8e0f-4924-a437-ee1214d33665" returned: 0 in 0.367s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "cinder-quobyte-d349f83d-8e0f-4924-a437-ee1214d33665" released by "delete_volume" :: held 0.863s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Created reservations ['8b811fdf-d25f-47a5-bd0e-70e2f00d77f4', '7d24fd55-52d0-4a4f-beac-343f9dcebc60', '60d5c027-173a-4eab-8a1e-b1a65fde660f', 'cc79635c-6a94-4c60-9661-e2fc21a340cd'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:30 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:54:30 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:30 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:30 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:54:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Deleted volume successfully.
Sep 25 11:54:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87ddb5d1-d5f4-4845-8a97-db9a62405b79 tempest-AbsoluteLimitsTests-1520842333 None] Lock "cinder-d349f83d-8e0f-4924-a437-ee1214d33665-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (e38fd4e9-dc41-4d5b-a677-3bcc775ac70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f3c4e5-ee30-4eec-ae37-a38e52f43276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f3c4e5-ee30-4eec-ae37-a38e52f43276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-342246491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b7165b-76c2-41d3-9cca-e70d2994debb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedec5d4153e49d08fb975f6f2a1d361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:37Z,use_quota=True,user_id='7b053d04e501448fbbd5f579572c00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78417791-a506-4dc6-8648-da8b03c7004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78417791-a506-4dc6-8648-da8b03c7004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f5ffa-7e2b-4b85-bd1a-b5796c13e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f5ffa-7e2b-4b85-bd1a-b5796c13e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b7165b-76c2-41d3-9cca-e70d2994debb', 'volume_name': 'volume-83b7165b-76c2-41d3-9cca-e70d2994debb', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1182df-8d01-43cb-b369-11640ff469e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1182df-8d01-43cb-b369-11640ff469e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46441cbc-2a15-4c7c-b4cf-f61c445d6a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:37 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Volume 83b7165b-76c2-41d3-9cca-e70d2994debb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b7165b-76c2-41d3-9cca-e70d2994debb', 'volume_size': 1}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-342246491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b7165b-76c2-41d3-9cca-e70d2994debb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedec5d4153e49d08fb975f6f2a1d361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:37Z,use_quota=True,user_id='7b053d04e501448fbbd5f579572c00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Creating volume 83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:37 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:37 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb 1073741824
Sep 25 11:54:37 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:37 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb 1073741824" returned: 0 in 0.480s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:37 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:37 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:38 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.276s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46441cbc-2a15-4c7c-b4cf-f61c445d6a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b7165b-76c2-41d3-9cca-e70d2994debb', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e17545a-b67e-454e-8e95-7e1b84d9a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:38 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Volume volume-83b7165b-76c2-41d3-9cca-e70d2994debb (83b7165b-76c2-41d3-9cca-e70d2994debb): created successfully
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e17545a-b67e-454e-8e95-7e1b84d9a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (e38fd4e9-dc41-4d5b-a677-3bcc775ac70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fa0b933f-534f-44cb-a461-b6a9af42849e tempest-VolumesDeleteCascade-671837539 None] Created volume successfully.
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Creating offline snapshot 5817354e-6b45-4370-a5c5-5185ef26212e of volume 83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[783d26bf-a8f1-429e-8e4c-86d82153eb50]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:39 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:39 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:39 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.418s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:39 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e 1G
Sep 25 11:54:39 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:40 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e 1G" returned: 0 in 0.515s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:40 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:40 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:40 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:40 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e is being set with open permissions: ugo+rw
Sep 25 11:54:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:40 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:40 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:41 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.318s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:41 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info
Sep 25 11:54:41 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:41 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info" returned: 0 in 0.359s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:41 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info is being set with open permissions: ugo+rw
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:41 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info
Sep 25 11:54:41 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:41 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.info" returned: 0 in 0.337s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4e2e8674-0ab3-47af-9676-eb086e1f3209 tempest-VolumesDeleteCascade-671837539 None] Create snapshot completed successfully
Sep 25 11:54:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Creating offline snapshot b4b07ed6-d0b2-4997-9c49-240c7040d107 of volume 83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:54:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d550b7-96bd-4aa2-a812-eaeae3570ac0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:43 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:43 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:43 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.422s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b7165b-76c2-41d3-9cca-e70d2994debb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:54:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:43 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 1G
Sep 25 11:54:43 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:43 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 1G" returned: 0 in 0.522s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:43 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:43 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:44 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.373s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:44 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 is being set with open permissions: ugo+rw
Sep 25 11:54:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:44 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:44 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:44 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.728s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7b7fc553-893e-45a9-99cb-2acddf13b0cc tempest-VolumesDeleteCascade-671837539 None] Create snapshot completed successfully
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-83b7165b-76c2-41d3-9cca-e70d2994debb-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-83b7165b-76c2-41d3-9cca-e70d2994debb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Performing cascade delete. {{(pid=87358) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-5817354e-6b45-4370-a5c5-5185ef26212e-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-5817354e-6b45-4370-a5c5-5185ef26212e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-5817354e-6b45-4370-a5c5-5185ef26212e" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5817354e-6b45-4370-a5c5-5185ef26212e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Deleting offline snapshot 5817354e-6b45-4370-a5c5-5185ef26212e of volume 83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] snapshot_file for this snap is: volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d380a-6c04-4ecc-80bd-47ed6448f863]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:45 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:45 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:45 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.449s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b7165b-76c2-41d3-9cca-e70d2994debb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ea1a79-3030-4ad2-9570-336b1e483bd3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:45 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:45 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:46 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.466s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ff664-3911-40f0-93dc-b88fd0c9b7df]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:46 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:46 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:46 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.471s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b7165b-76c2-41d3-9cca-e70d2994debb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e634cde-6507-4445-b125-272598584044]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:46 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:46 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:47 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.475s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b7165b-76c2-41d3-9cca-e70d2994debb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a6fdd3-2e95-4877-81f1-2dfda03a355f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:47 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:47 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:47 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:47 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:47 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:48 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.416s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:48 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e
Sep 25 11:54:48 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:48 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.5817354e-6b45-4370-a5c5-5185ef26212e" returned: 0 in 0.287s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 -F qcow2 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:48 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 -F qcow2
Sep 25 11:54:48 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:48 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b7165b-76c2-41d3-9cca-e70d2994debb /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 -F qcow2" returned: 0 in 0.322s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5817354e-6b45-4370-a5c5-5185ef26212e" released by "_delete_snapshot" :: held 3.484s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" released by "delete_snapshot" :: held 3.509s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Created reservations ['641866d2-0c5b-4693-88e4-df1bd41dae51', 'c4f22a68-52a1-41bf-983e-4d70352740b3', '7c501b7b-3084-4586-ab90-694c069fe00c', '1c7b639e-f8cb-4612-84c7-036eb9fb8858'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Delete snapshot completed successfully.
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-5817354e-6b45-4370-a5c5-5185ef26212e-delete_snapshot" released by "delete_snapshot" :: held 3.688s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-b4b07ed6-d0b2-4997-9c49-240c7040d107-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-b4b07ed6-d0b2-4997-9c49-240c7040d107-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-b4b07ed6-d0b2-4997-9c49-240c7040d107" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-b4b07ed6-d0b2-4997-9c49-240c7040d107" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Deleting offline snapshot b4b07ed6-d0b2-4997-9c49-240c7040d107 of volume 83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] snapshot_file for this snap is: volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f287fd57-ed81-4563-a8be-6fc136a6f614]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:49 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:49 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:49 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b7165b-76c2-41d3-9cca-e70d2994debb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d8f0b4-ccfd-4c61-9e28-a5ed84eb1e4e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:49 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:49 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:49 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.465s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:49 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:49 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:50 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.367s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:50 devstack sudo[105719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107
Sep 25 11:54:50 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:50 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb.b4b07ed6-d0b2-4997-9c49-240c7040d107" returned: 0 in 0.277s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-b4b07ed6-d0b2-4997-9c49-240c7040d107" released by "_delete_snapshot" :: held 1.647s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" released by "delete_snapshot" :: held 1.673s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Created reservations ['b63b22ea-3f07-43b2-87fd-f9766c0bf4f3', 'de7a67d6-455b-45bb-8ac5-9a9803a47e16', '420dbab2-2375-4452-9edb-d4c8e85f3a89', 'bef495cd-a892-4757-8c4a-bfaa8f09c8d1'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Delete snapshot completed successfully.
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-b4b07ed6-d0b2-4997-9c49-240c7040d107-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Snapshots deleted, issuing volume delete {{(pid=87358) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5526f5eb-1a96-4f47-a30f-6c5494ba3fab]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:50 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:50 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:51 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:51 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb
Sep 25 11:54:51 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:51 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:54:51 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:51 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-83b7165b-76c2-41d3-9cca-e70d2994debb" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-83b7165b-76c2-41d3-9cca-e70d2994debb" released by "delete_volume" :: held 0.927s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Created reservations ['44419592-7488-46a6-bb81-d8db7c9e519a', '35aaf211-7f47-4738-9a2a-f28fdf583f07', '4d7526eb-ac4d-4084-8966-77d93547d698', '2bcaaa3b-e26a-430a-82a9-fc13321a7ef9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:51 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:54:51 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:51 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.403s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b2acc6a1-3181-468c-851a-23ffd9ce97f7 req-f093242a-e678-47f0-a2c1-df25dc4545e5 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b2acc6a1-3181-468c-851a-23ffd9ce97f7 req-f093242a-e678-47f0-a2c1-df25dc4545e5 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-b2acc6a1-3181-468c-851a-23ffd9ce97f7 req-f093242a-e678-47f0-a2c1-df25dc4545e5 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-b2acc6a1-3181-468c-851a-23ffd9ce97f7 req-f093242a-e678-47f0-a2c1-df25dc4545e5 tempest-TestServerVolumeAttachmentScenario-637625990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e836fc4b-05b9-4228-89f8-8448e5ceef99', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:54:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-b2acc6a1-3181-468c-851a-23ffd9ce97f7 req-f093242a-e678-47f0-a2c1-df25dc4545e5 tempest-TestServerVolumeAttachmentScenario-637625990 None] attachment_update completed successfully.
Sep 25 11:54:52 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.343s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:52 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:54:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Deleted volume successfully.
Sep 25 11:54:52 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f0c9c09c-b3a4-48eb-b1c6-74abfac64516 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-83b7165b-76c2-41d3-9cca-e70d2994debb-delete_volume" released by "delete_volume" :: held 7.152s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (25eced36-e8a0-415b-956c-97b5cd3048b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afee6f3c-2075-4ea7-9ae2-2e6c37f975d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afee6f3c-2075-4ea7-9ae2-2e6c37f975d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1927584105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e20124e-28f4-4b55-b258-0378979f4732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedec5d4153e49d08fb975f6f2a1d361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:54Z,use_quota=True,user_id='7b053d04e501448fbbd5f579572c00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f014fd-87df-4a75-a547-a064d9dfb265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f014fd-87df-4a75-a547-a064d9dfb265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a746186-f3b6-4944-a755-2ca3d7ee6f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a746186-f3b6-4944-a755-2ca3d7ee6f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e20124e-28f4-4b55-b258-0378979f4732', 'volume_name': 'volume-5e20124e-28f4-4b55-b258-0378979f4732', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261bb04e-5cd0-4224-8273-9aad51ccbcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261bb04e-5cd0-4224-8273-9aad51ccbcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecbc126-8b11-4781-8095-a190f4b866be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Volume 5e20124e-28f4-4b55-b258-0378979f4732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e20124e-28f4-4b55-b258-0378979f4732', 'volume_size': 1}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1927584105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e20124e-28f4-4b55-b258-0378979f4732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedec5d4153e49d08fb975f6f2a1d361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:54Z,use_quota=True,user_id='7b053d04e501448fbbd5f579572c00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Creating volume 5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:54:53 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:54:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:53 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 1073741824
Sep 25 11:54:53 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:54 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 1073741824" returned: 0 in 0.511s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:54 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:54:54 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:54 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.297s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecbc126-8b11-4781-8095-a190f4b866be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e20124e-28f4-4b55-b258-0378979f4732', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce20b6ba-8d48-4a2f-b22f-4bfe6dcac60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:54:54 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Volume volume-5e20124e-28f4-4b55-b258-0378979f4732 (5e20124e-28f4-4b55-b258-0378979f4732): created successfully
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce20b6ba-8d48-4a2f-b22f-4bfe6dcac60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:54:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (25eced36-e8a0-415b-956c-97b5cd3048b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:54:54 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-11f9b58b-7a97-47ce-a7fb-c1c975ccd263 tempest-VolumesDeleteCascade-671837539 None] Created volume successfully.
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Creating offline snapshot 53ae762f-96ff-4d33-af2b-afd3f9b2becb of volume 5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e055eb-e3b4-41f9-a172-a3d7c08c651d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:56 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:54:56 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:56 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.483s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:56 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb 1G
Sep 25 11:54:56 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-49b7f89f-8bc4-4cda-9e10-90c3580d125f req-8c6c1281-9570-44d1-b9c9-ec74ce6576a1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:54:57 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb 1G" returned: 0 in 0.503s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e20124e-28f4-4b55-b258-0378979f4732 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:57 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e20124e-28f4-4b55-b258-0378979f4732 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:54:57 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:57 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e20124e-28f4-4b55-b258-0378979f4732 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:57 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb is being set with open permissions: ugo+rw
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:57 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:54:57 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:57 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:57 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info
Sep 25 11:54:57 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:58 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:58 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info is being set with open permissions: ugo+rw
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:54:58 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info
Sep 25 11:54:58 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:54:58 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.info" returned: 0 in 0.294s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-49b7f89f-8bc4-4cda-9e10-90c3580d125f req-8c6c1281-9570-44d1-b9c9-ec74ce6576a1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.721s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [req-49b7f89f-8bc4-4cda-9e10-90c3580d125f req-8c6c1281-9570-44d1-b9c9-ec74ce6576a1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:54:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ceb1e59b-4085-4dec-92df-0591ee95ae16 tempest-VolumesDeleteCascade-671837539 None] Create snapshot completed successfully
Sep 25 11:54:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-49b7f89f-8bc4-4cda-9e10-90c3580d125f req-8c6c1281-9570-44d1-b9c9-ec74ce6576a1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2', 'name': 'volume-6204c033-a77e-4d1c-87c2-03b73be9717e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bccf97e-d036-41ce-9a11-b2bca1856a61', 'enforce_multipath': True} {{(pid=87358) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 11:54:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-49b7f89f-8bc4-4cda-9e10-90c3580d125f req-8c6c1281-9570-44d1-b9c9-ec74ce6576a1 tempest-TestServerVolumeAttachmentScenario-637625990 None] attachment_update completed successfully.
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (1c9f631b-bd7d-438d-9a58-2ded3c41b6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f295f-12cd-409c-84df-6003d9af8b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f295f-12cd-409c-84df-6003d9af8b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1464057438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39868978-5375-400d-a0ed-2bc4993a0a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedec5d4153e49d08fb975f6f2a1d361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53ae762f-96ff-4d33-af2b-afd3f9b2becb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:00Z,use_quota=True,user_id='7b053d04e501448fbbd5f579572c00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359d65af-b844-4ee5-835a-49d753a026c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359d65af-b844-4ee5-835a-49d753a026c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaee738c-ce99-46a9-ae1d-4fca5d01aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaee738c-ce99-46a9-ae1d-4fca5d01aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39868978-5375-400d-a0ed-2bc4993a0a7c', 'volume_name': 'volume-39868978-5375-400d-a0ed-2bc4993a0a7c', 'volume_size': 1, 'snapshot_id': '53ae762f-96ff-4d33-af2b-afd3f9b2becb'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd4744e-5a90-422a-a1be-fcdc3bb268ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd4744e-5a90-422a-a1be-fcdc3bb268ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c031070d-77ca-44a6-9340-2be56306efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Volume 39868978-5375-400d-a0ed-2bc4993a0a7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39868978-5375-400d-a0ed-2bc4993a0a7c', 'volume_size': 1, 'snapshot_id': '53ae762f-96ff-4d33-af2b-afd3f9b2becb'}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb-39868978-5375-400d-a0ed-2bc4993a0a7c" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb-39868978-5375-400d-a0ed-2bc4993a0a7c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Creating volume 39868978-5375-400d-a0ed-2bc4993a0a7c from snapshot 53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] snapshot: 53ae762f-96ff-4d33-af2b-afd3f9b2becb, volume: 39868978-5375-400d-a0ed-2bc4993a0a7c,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccc22e-82db-4db6-a55c-f25fab518878]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:00 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:55:00 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:00 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e20124e-28f4-4b55-b258-0378979f4732(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8534e2-6bde-44fc-a6c7-a1320ef2a46a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-2864e728-1183-4335-a978-b9b01e0821d0 req-ef55053e-db9c-4fce-b8df-1b6df70c691e tempest-TestServerVolumeAttachmentScenario-637625990 None] Terminate volume connection completed successfully.
Sep 25 11:55:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-2864e728-1183-4335-a978-b9b01e0821d0 req-ef55053e-db9c-4fce-b8df-1b6df70c691e tempest-TestServerVolumeAttachmentScenario-637625990 None] Deleting attachment 0bccf97e-d036-41ce-9a11-b2bca1856a61. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:55:00 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:55:00 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:01 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.459s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:55:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:55:01 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:55:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:01 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c
Sep 25 11:55:01 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [req-7b6bd2e7-22eb-4c97-8500-395314090f55 req-917310cf-0f96-4e7b-bbee-5b2c54fe4405 tempest-TestServerVolumeAttachmentScenario-637625990 None] Terminate volume connection completed successfully.
Sep 25 11:55:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [req-7b6bd2e7-22eb-4c97-8500-395314090f55 req-917310cf-0f96-4e7b-bbee-5b2c54fe4405 tempest-TestServerVolumeAttachmentScenario-637625990 None] Deleting attachment e836fc4b-05b9-4228-89f8-8448e5ceef99. {{(pid=87358) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 11:55:09 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c" returned: 0 in 8.096s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:55:09 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Converted 1024.00 MB image at 126.47 MB/s
Sep 25 11:55:09 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c is being set with open permissions: ugo+rw
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:09 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c
Sep 25 11:55:09 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:09 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c" returned: 0 in 0.377s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" released by "_copy_volume_from_snapshot" :: held 9.471s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb-39868978-5375-400d-a0ed-2bc4993a0a7c" released by "_create_volume_from_snapshot" :: held 9.564s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.590s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c031070d-77ca-44a6-9340-2be56306efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39868978-5375-400d-a0ed-2bc4993a0a7c', 'volume_size': 1, 'snapshot_id': '53ae762f-96ff-4d33-af2b-afd3f9b2becb'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51e30cb-1050-44cb-96a9-d639186a2d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:09 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Volume volume-39868978-5375-400d-a0ed-2bc4993a0a7c (39868978-5375-400d-a0ed-2bc4993a0a7c): created successfully
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51e30cb-1050-44cb-96a9-d639186a2d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Flow 'volume_create_manager' (1c9f631b-bd7d-438d-9a58-2ded3c41b6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a1e76d68-8ee5-4abe-92d0-0165c0f3b7cc tempest-VolumesDeleteCascade-671837539 None] Created volume successfully.
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-5e20124e-28f4-4b55-b258-0378979f4732-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-5e20124e-28f4-4b55-b258-0378979f4732-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Performing cascade delete. {{(pid=87358) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-53ae762f-96ff-4d33-af2b-afd3f9b2becb-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-53ae762f-96ff-4d33-af2b-afd3f9b2becb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Deleting offline snapshot 53ae762f-96ff-4d33-af2b-afd3f9b2becb of volume 5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] snapshot_file for this snap is: volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f3965-1ba8-4dad-8ebf-acc3c759e3d3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:10 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:55:10 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:11 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.467s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e20124e-28f4-4b55-b258-0378979f4732(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a25e015-0699-4d69-9723-99443f895fea]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:11 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:55:11 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:11 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "cinder-6204c033-a77e-4d1c-87c2-03b73be9717e-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.726s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-6204c033-a77e-4d1c-87c2-03b73be9717e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:11 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:55:11 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "cinder-quobyte-6204c033-a77e-4d1c-87c2-03b73be9717e" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-quobyte-6204c033-a77e-4d1c-87c2-03b73be9717e" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ca66f-6ae8-472a-9400-126f35ac1b29]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:12 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e
Sep 25 11:55:12 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:12 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.412s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:12 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb
Sep 25 11:55:12 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:12 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e" returned: 0 in 0.484s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:12 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e
Sep 25 11:55:12 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:12 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732.53ae762f-96ff-4d33-af2b-afd3f9b2becb" returned: 0 in 0.335s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-53ae762f-96ff-4d33-af2b-afd3f9b2becb" released by "_delete_snapshot" :: held 2.087s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" released by "delete_snapshot" :: held 2.117s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Created reservations ['f9182d87-8fb7-45e8-afc0-8298a4721ee1', 'd4fcc105-445f-4a74-8570-213bec94a03f', '3c606f02-4193-45b3-9e07-2a01a519dbfa', '84fe65c6-e57a-4354-a452-4fefccfae1f3'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:12 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6204c033-a77e-4d1c-87c2-03b73be9717e" returned: 0 in 0.345s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Delete snapshot completed successfully.
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-quobyte-6204c033-a77e-4d1c-87c2-03b73be9717e" released by "delete_volume" :: held 0.882s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-53ae762f-96ff-4d33-af2b-afd3f9b2becb-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Snapshots deleted, issuing volume delete {{(pid=87358) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641e523-3c0a-43a2-bf91-bed605c03ebd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Created reservations ['959c7817-067d-46dc-b2f9-a1ffc3692ed5', '6a16b2eb-c449-4e77-aa07-abff91ce55d9', '76b24932-2fe9-4a30-9f9f-6e20c89587ee', '9aeab822-c1c1-472b-9294-5c083266cfcb'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:13 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:55:13 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:13 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:13 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:13 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Deleted volume successfully.
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d62018ac-a2f4-4e95-93cd-c99a79b3487a tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-6204c033-a77e-4d1c-87c2-03b73be9717e-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:13 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.517s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:13 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732
Sep 25 11:55:13 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:13 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5e20124e-28f4-4b55-b258-0378979f4732" returned: 0 in 0.303s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-5e20124e-28f4-4b55-b258-0378979f4732" released by "delete_volume" :: held 0.905s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Created reservations ['1f1570da-d677-44bc-a347-f51230998573', '0156d8b7-1ec9-46d3-9b8d-7891b1c148b7', '097a4e94-7bf4-4cf5-8942-50b929949512', '5eea633c-c33e-4f17-aa9b-768e6b060f0b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:14 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:14 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "cinder-9cb4da2d-85a5-425b-a651-1d120a67f9c6-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-9cb4da2d-85a5-425b-a651-1d120a67f9c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "cinder-quobyte-9cb4da2d-85a5-425b-a651-1d120a67f9c6" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-quobyte-9cb4da2d-85a5-425b-a651-1d120a67f9c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8d942-c794-4a96-b961-49d1ed782bfd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:14 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Deleted volume successfully.
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0eeeb311-ff03-4892-a7e1-9765b0f17d86 tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-5e20124e-28f4-4b55-b258-0378979f4732-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:14 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6
Sep 25 11:55:14 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:14 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6" returned: 0 in 0.463s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:14 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6
Sep 25 11:55:14 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:15 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9cb4da2d-85a5-425b-a651-1d120a67f9c6" returned: 0 in 0.331s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-quobyte-9cb4da2d-85a5-425b-a651-1d120a67f9c6" released by "delete_volume" :: held 0.851s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-39868978-5375-400d-a0ed-2bc4993a0a7c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Created reservations ['fe06b703-84eb-4ce2-a4f1-7fff9267edd8', 'db3a3e79-adf4-44b1-9329-c8b1a8ffca48', '83115aa6-0414-432c-9212-9818afb16fef', '7728fb40-1968-40e8-8f1a-61245d9a3048'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-39868978-5375-400d-a0ed-2bc4993a0a7c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" acquired by "delete_volume" :: waited 0.057s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[db648776-8a75-4c12-b641-ad9bac690cda]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:15 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:15 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:15 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c
Sep 25 11:55:15 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:15 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.325s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Deleted volume successfully.
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=85,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:55:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e0e62b0e-e5e4-485e-825d-72180fc9a4e1 tempest-TestServerVolumeAttachmentScenario-637625990 None] Lock "cinder-9cb4da2d-85a5-425b-a651-1d120a67f9c6-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:16 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c" returned: 0 in 0.549s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:16 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c
Sep 25 11:55:16 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:16 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-39868978-5375-400d-a0ed-2bc4993a0a7c" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-quobyte-39868978-5375-400d-a0ed-2bc4993a0a7c" released by "delete_volume" :: held 1.055s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=87,cinder:SELECT=77,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Created reservations ['cdd73026-c183-4154-8872-07808e5fa542', 'fac3d3a7-0ced-4db5-9c21-679f98d839fe', '1b9d81a1-260c-4513-aed1-f418df449a34', '401aa91a-e278-4530-a10f-07fcc27a24a4'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:16 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:16 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:17 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.352s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:17 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Deleted volume successfully.
Sep 25 11:55:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5e5afe22-7e07-4995-aaf6-8eed5a7aa78e tempest-VolumesDeleteCascade-671837539 None] Lock "cinder-39868978-5375-400d-a0ed-2bc4993a0a7c-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Flow 'volume_create_manager' (1cd8a8ee-f4f3-43e4-983e-8b9b2c70d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f082dc6-14ef-45d7-b604-760985c96297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f082dc6-14ef-45d7-b604-760985c96297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1274966146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206de0f0-40d3-4762-8bb1-99307e3a5e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bf39f41ff4bf7ae2adc9e9943b4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:23Z,use_quota=True,user_id='25ef5d87c3fd4478a33e0951e8a67d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66222081-a66f-4102-8983-a0f098a6aed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66222081-a66f-4102-8983-a0f098a6aed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc0161-5fc5-4128-8a16-80dac2f19e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc0161-5fc5-4128-8a16-80dac2f19e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206de0f0-40d3-4762-8bb1-99307e3a5e43', 'volume_name': 'volume-206de0f0-40d3-4762-8bb1-99307e3a5e43', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9710e39e-94a2-43b9-b0ff-cc1d2497dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9710e39e-94a2-43b9-b0ff-cc1d2497dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391f2e7d-a973-4690-8699-e0520e6fb2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Volume 206de0f0-40d3-4762-8bb1-99307e3a5e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206de0f0-40d3-4762-8bb1-99307e3a5e43', 'volume_size': 1}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1274966146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206de0f0-40d3-4762-8bb1-99307e3a5e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bf39f41ff4bf7ae2adc9e9943b4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:23Z,use_quota=True,user_id='25ef5d87c3fd4478a33e0951e8a67d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Creating volume 206de0f0-40d3-4762-8bb1-99307e3a5e43 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:22 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:22 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 1073741824
Sep 25 11:55:22 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:23 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 1073741824" returned: 0 in 0.526s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:23 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43
Sep 25 11:55:23 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:23 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43" returned: 0 in 0.293s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391f2e7d-a973-4690-8699-e0520e6fb2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206de0f0-40d3-4762-8bb1-99307e3a5e43', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d276d797-a86b-4738-872c-12bc01ad12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Volume volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 (206de0f0-40d3-4762-8bb1-99307e3a5e43): created successfully
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d276d797-a86b-4738-872c-12bc01ad12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Flow 'volume_create_manager' (1cd8a8ee-f4f3-43e4-983e-8b9b2c70d50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-124c6af6-4871-4229-b28c-2ab417faea72 tempest-VolumesMetadataTest-1162198218 None] Created volume successfully.
Sep 25 11:55:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Acquiring lock "cinder-206de0f0-40d3-4762-8bb1-99307e3a5e43-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "cinder-206de0f0-40d3-4762-8bb1-99307e3a5e43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Acquiring lock "cinder-quobyte-206de0f0-40d3-4762-8bb1-99307e3a5e43" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "cinder-quobyte-206de0f0-40d3-4762-8bb1-99307e3a5e43" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7abc2b-1be4-4d39-8caf-a47974b93d8b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:26 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43
Sep 25 11:55:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43" returned: 0 in 0.473s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:26 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43
Sep 25 11:55:26 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:26 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-206de0f0-40d3-4762-8bb1-99307e3a5e43" returned: 0 in 0.293s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "cinder-quobyte-206de0f0-40d3-4762-8bb1-99307e3a5e43" released by "delete_volume" :: held 0.824s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Created reservations ['4f705cd8-523d-462d-b3d0-5f2cccc73ec3', '187166f8-adde-4b8f-ae66-c0fd4b0b28f1', 'd6661f2c-a7f4-4273-95fb-4572ad44f670', 'f5091e10-8cb2-4c34-a2af-f103d08b3c72'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:27 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:27 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:27 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.317s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:27 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Deleted volume successfully.
Sep 25 11:55:27 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-39057a86-23dc-48aa-b44f-b4a28d3f4c06 tempest-VolumesMetadataTest-1162198218 None] Lock "cinder-206de0f0-40d3-4762-8bb1-99307e3a5e43-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Flow 'volume_create_manager' (47731fde-fd69-4ff6-9686-ac1c0f7ca35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47218e9-6822-4b05-9fba-a3465f0f2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47218e9-6822-4b05-9fba-a3465f0f2526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f2936b-be19-4fad-8c68-da803854a903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e0d5081cd45fa8e0a06457b7b5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:31Z,use_quota=True,user_id='c33ee8cbe7644baf88fa9f93c68e236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2b0fc0-a7ec-470b-b0a5-d3dc4ac4d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2b0fc0-a7ec-470b-b0a5-d3dc4ac4d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e5a746-87a9-4197-b42c-324f8fa1c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e5a746-87a9-4197-b42c-324f8fa1c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f2936b-be19-4fad-8c68-da803854a903', 'volume_name': 'volume-a2f2936b-be19-4fad-8c68-da803854a903', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e47c1a-cc16-4f5e-b7ac-319c365ce89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e47c1a-cc16-4f5e-b7ac-319c365ce89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb920b-6482-4d9d-b120-bf3da3db1809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:31 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Volume a2f2936b-be19-4fad-8c68-da803854a903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f2936b-be19-4fad-8c68-da803854a903', 'volume_size': 1}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f2936b-be19-4fad-8c68-da803854a903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e0d5081cd45fa8e0a06457b7b5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:31Z,use_quota=True,user_id='c33ee8cbe7644baf88fa9f93c68e236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Creating volume a2f2936b-be19-4fad-8c68-da803854a903 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:31 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:31 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 1073741824
Sep 25 11:55:31 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:32 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 1073741824" returned: 0 in 0.589s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Flow 'volume_create_manager' (cb035453-4625-4297-b521-0e70e74c5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c98fb4-6d57-4022-bb0e-26477546a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c98fb4-6d57-4022-bb0e-26477546a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1557184177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7af5e32-1c1f-4d6c-80fe-b422ba331c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76aba148df846f6aab04d7ad2dc2abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:32Z,use_quota=True,user_id='bf22c9d5504e4cffb2df0cd6d50d8b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903
Sep 25 11:55:32 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4024353-3a29-4ed7-a31c-5d74591dc44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4024353-3a29-4ed7-a31c-5d74591dc44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455327ac-d936-40ff-8dc5-8a0e52ecda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455327ac-d936-40ff-8dc5-8a0e52ecda4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7af5e32-1c1f-4d6c-80fe-b422ba331c8a', 'volume_name': 'volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a', 'volume_size': 2}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e2f6f1-5877-4305-9a3f-25a2d633f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e2f6f1-5877-4305-9a3f-25a2d633f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9837fd3-20c8-4955-afa9-00adc732a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Volume c7af5e32-1c1f-4d6c-80fe-b422ba331c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a', 'volume_size': 2}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:32 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903" returned: 0 in 0.297s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1557184177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7af5e32-1c1f-4d6c-80fe-b422ba331c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76aba148df846f6aab04d7ad2dc2abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:32Z,use_quota=True,user_id='bf22c9d5504e4cffb2df0cd6d50d8b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Creating volume c7af5e32-1c1f-4d6c-80fe-b422ba331c8a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:32 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a 2147483648 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:32 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a 2147483648
Sep 25 11:55:32 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb920b-6482-4d9d-b120-bf3da3db1809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f2936b-be19-4fad-8c68-da803854a903', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f358b-69ff-4301-8f1d-7182aaa488f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Volume volume-a2f2936b-be19-4fad-8c68-da803854a903 (a2f2936b-be19-4fad-8c68-da803854a903): created successfully
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f358b-69ff-4301-8f1d-7182aaa488f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Flow 'volume_create_manager' (47731fde-fd69-4ff6-9686-ac1c0f7ca35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-603995d2-4376-45ee-99aa-bcaa0f2aa508 tempest-CinderUnicodeTest-343819772 None] Created volume successfully.
Sep 25 11:55:33 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a 2147483648" returned: 0 in 0.557s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:33 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a
Sep 25 11:55:33 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:33 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" returned: 0 in 0.266s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9837fd3-20c8-4955-afa9-00adc732a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a', 'volume_size': 2}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d1765a-f38c-4ca5-828e-16da3a0cd4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:33 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Volume volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a (c7af5e32-1c1f-4d6c-80fe-b422ba331c8a): created successfully
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d1765a-f38c-4ca5-828e-16da3a0cd4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Flow 'volume_create_manager' (cb035453-4625-4297-b521-0e70e74c5117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d0bec8c7-ddeb-4381-9104-bfee0368aae5 tempest-VolumesCloneNegativeTest-1053670005 None] Created volume successfully.
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Flow 'volume_create_manager' (fd44a66c-54a0-46f8-9678-81ff5ff99c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5943e67e-02b4-4ef4-b953-c6eecc486684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5943e67e-02b4-4ef4-b953-c6eecc486684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-176323325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea40496d-721b-4499-8479-7cb653d51811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e0d5081cd45fa8e0a06457b7b5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:34Z,use_quota=True,user_id='c33ee8cbe7644baf88fa9f93c68e236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e090ca-6730-456d-a913-1d66c8642cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e090ca-6730-456d-a913-1d66c8642cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b73f21-edce-4f96-9c97-bd5722e61564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b73f21-edce-4f96-9c97-bd5722e61564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea40496d-721b-4499-8479-7cb653d51811', 'volume_name': 'volume-ea40496d-721b-4499-8479-7cb653d51811', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5b461a-c70d-4e0d-9a92-886b1b1e0c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5b461a-c70d-4e0d-9a92-886b1b1e0c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292f1696-4322-4e6b-a513-d9e53b24d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:34 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Volume ea40496d-721b-4499-8479-7cb653d51811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea40496d-721b-4499-8479-7cb653d51811', 'volume_size': 1}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-176323325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea40496d-721b-4499-8479-7cb653d51811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e0d5081cd45fa8e0a06457b7b5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:34Z,use_quota=True,user_id='c33ee8cbe7644baf88fa9f93c68e236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Creating volume ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:34 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:34 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 1073741824
Sep 25 11:55:34 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Acquiring lock "cinder-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "cinder-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Acquiring lock "cinder-quobyte-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "cinder-quobyte-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[664028dc-7c47-4a07-9570-07aeebcd1294]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:34 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 1073741824" returned: 0 in 0.550s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:34 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a
Sep 25 11:55:34 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:34 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811
Sep 25 11:55:34 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:35 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" returned: 0 in 0.519s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:35 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:35 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a
Sep 25 11:55:35 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292f1696-4322-4e6b-a513-d9e53b24d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea40496d-721b-4499-8479-7cb653d51811', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b8cca5-5cda-46e4-b524-3608dd6cf935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:35 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Volume volume-ea40496d-721b-4499-8479-7cb653d51811 (ea40496d-721b-4499-8479-7cb653d51811): created successfully
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b8cca5-5cda-46e4-b524-3608dd6cf935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Flow 'volume_create_manager' (fd44a66c-54a0-46f8-9678-81ff5ff99c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-dc569fc5-a27a-41e6-95ec-8cfdfea97529 tempest-CinderUnicodeTest-343819772 None] Created volume successfully.
Sep 25 11:55:35 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "cinder-quobyte-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a" released by "delete_volume" :: held 0.852s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Created reservations ['33e2e5b9-33cf-4a47-bcac-9c1b0b4cd4c7', '5236f249-62ca-4ca5-99e3-aa7a158b2389', '95544488-b51a-4efd-81f5-24458e36f47f', '74dd10e8-f957-4249-997d-e2c80d655cf8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:35 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:35 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:35 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:35 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Deleted volume successfully.
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4859bffd-964d-43a0-9121-15cd0624334f tempest-VolumesCloneNegativeTest-1053670005 None] Lock "cinder-c7af5e32-1c1f-4d6c-80fe-b422ba331c8a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Creating offline snapshot 5da32cb1-9a31-49ec-882f-a29541bed881 of volume ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ffd10-33b4-47ea-a43b-69ebd5ecd799]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:36 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811
Sep 25 11:55:36 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:37 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:37 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 1G
Sep 25 11:55:37 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:37 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 1G" returned: 0 in 0.569s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea40496d-721b-4499-8479-7cb653d51811 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:37 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea40496d-721b-4499-8479-7cb653d51811 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881
Sep 25 11:55:37 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:38 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea40496d-721b-4499-8479-7cb653d51811 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:38 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 is being set with open permissions: ugo+rw
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:38 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881
Sep 25 11:55:38 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:38 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881" returned: 0 in 0.301s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:38 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info
Sep 25 11:55:38 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:38 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:38 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info is being set with open permissions: ugo+rw
Sep 25 11:55:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:38 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info
Sep 25 11:55:38 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:39 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.info" returned: 0 in 0.305s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c7c51dcf-4848-40c6-a70a-6d8d2e8f8581 tempest-CinderUnicodeTest-343819772 None] Create snapshot completed successfully
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-5da32cb1-9a31-49ec-882f-a29541bed881-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-5da32cb1-9a31-49ec-882f-a29541bed881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-quobyte-5da32cb1-9a31-49ec-882f-a29541bed881" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-5da32cb1-9a31-49ec-882f-a29541bed881" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Deleting offline snapshot 5da32cb1-9a31-49ec-882f-a29541bed881 of volume ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] snapshot_file for this snap is: volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8a8d8a-b8ba-43e7-84a4-4489a1f0d139]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:40 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881
Sep 25 11:55:40 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:40 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (0f8f6df3-3255-4bf6-ac8e-13e774ae19f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8b1ca2-7029-4081-be94-a2d73c283f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881" returned: 0 in 0.474s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea40496d-721b-4499-8479-7cb653d51811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8b1ca2-7029-4081-be94-a2d73c283f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645201280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194019b6-92aa-4484-9106-bc79e575a367,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:40Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7b494f-de32-4999-b742-f54b7ab42aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7b494f-de32-4999-b742-f54b7ab42aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080001fc-a6e5-45f5-927d-052edaf4eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080001fc-a6e5-45f5-927d-052edaf4eda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194019b6-92aa-4484-9106-bc79e575a367', 'volume_name': 'volume-194019b6-92aa-4484-9106-bc79e575a367', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aa33aa-2d7f-4ce3-b92a-2822d6bca97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aa33aa-2d7f-4ce3-b92a-2822d6bca97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3952a64e-d355-4e94-ad9b-9ebe95f5b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:40 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Volume 194019b6-92aa-4484-9106-bc79e575a367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194019b6-92aa-4484-9106-bc79e575a367', 'volume_size': 1}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645201280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194019b6-92aa-4484-9106-bc79e575a367,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:40Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Creating volume 194019b6-92aa-4484-9106-bc79e575a367 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:40 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ac414-f617-4673-bcd9-c2c091555056]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:40 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 1073741824
Sep 25 11:55:40 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:40 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811
Sep 25 11:55:40 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:40 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811" returned: 0 in 0.406s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:40 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881
Sep 25 11:55:40 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:41 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 1073741824" returned: 0 in 0.514s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:41 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367
Sep 25 11:55:41 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:41 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881" returned: 0 in 0.436s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:41 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367" returned: 0 in 0.306s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:41 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3952a64e-d355-4e94-ad9b-9ebe95f5b512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194019b6-92aa-4484-9106-bc79e575a367', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:41 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd4bd52-3add-4832-9886-6ef5ac0092f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:41 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Volume volume-194019b6-92aa-4484-9106-bc79e575a367 (194019b6-92aa-4484-9106-bc79e575a367): created successfully
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd4bd52-3add-4832-9886-6ef5ac0092f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (0f8f6df3-3255-4bf6-ac8e-13e774ae19f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-43d230c6-6048-41a0-bbca-2c4a2b14fb13 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:55:41 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811.5da32cb1-9a31-49ec-882f-a29541bed881" returned: 0 in 0.285s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-5da32cb1-9a31-49ec-882f-a29541bed881" released by "_delete_snapshot" :: held 1.789s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" released by "delete_snapshot" :: held 1.822s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Created reservations ['d542a9d5-f789-4930-b30e-cd0ad563f342', 'ef832eeb-f870-4ec6-b112-07f27d1de757', 'a49977de-affe-48d2-b9eb-204d35fac2da', 'bbea664b-79b0-4173-816a-f9a5ecfe8ac7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Delete snapshot completed successfully.
Sep 25 11:55:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eee5045c-4544-4960-84d4-5d38053818e6 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-5da32cb1-9a31-49ec-882f-a29541bed881-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-ea40496d-721b-4499-8479-7cb653d51811-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-ea40496d-721b-4499-8479-7cb653d51811-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78ef57-ebcd-4d3d-bb11-3cdf5fd2036b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:42 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811
Sep 25 11:55:42 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:42 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811" returned: 0 in 0.442s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:42 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811
Sep 25 11:55:42 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:42 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ea40496d-721b-4499-8479-7cb653d51811" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-ea40496d-721b-4499-8479-7cb653d51811" released by "delete_volume" :: held 0.884s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Created reservations ['fbbaeeba-51dd-4363-be3a-aa8599e06ab7', '8df84763-f09e-4476-8c05-b6c26d2ab4b9', '0f9a0540-298d-4f09-a20c-259eb904cf69', '512c944b-ed0f-4f5f-a119-f671e098000a'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:43 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:43 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-a2f2936b-be19-4fad-8c68-da803854a903-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-a2f2936b-be19-4fad-8c68-da803854a903-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "cinder-quobyte-a2f2936b-be19-4fad-8c68-da803854a903" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-a2f2936b-be19-4fad-8c68-da803854a903" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e705bf-7bbf-47c9-b627-62f62ff2e810]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:43 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903
Sep 25 11:55:43 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (a35dc8ef-ac03-4a93-bde3-9052002d32f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa22e450-5ff0-4a7b-9af6-afc967ebcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:43 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa22e450-5ff0-4a7b-9af6-afc967ebcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610068545',display_name='tempest-VolumesGetTest-Volume-114874301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134cd56-f3c3-4aa7-af78-0ff7584f12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:44Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003be31-1e9d-401a-9109-04dd88955c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003be31-1e9d-401a-9109-04dd88955c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8dd6b6-c484-4f6e-85e5-220b7a4325b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8dd6b6-c484-4f6e-85e5-220b7a4325b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd134cd56-f3c3-4aa7-af78-0ff7584f12a5', 'volume_name': 'volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82655cae-c077-47cf-be74-da7a0282775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82655cae-c077-47cf-be74-da7a0282775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d16c2b-556b-4540-ad3c-6db41ff90e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:43 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Volume d134cd56-f3c3-4aa7-af78-0ff7584f12a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5', 'volume_size': 1}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610068545',display_name='tempest-VolumesGetTest-Volume-114874301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134cd56-f3c3-4aa7-af78-0ff7584f12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:44Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Creating volume d134cd56-f3c3-4aa7-af78-0ff7584f12a5 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:43 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Deleted volume successfully.
Sep 25 11:55:43 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 1073741824
Sep 25 11:55:43 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8c03d534-4dfd-4ca1-9473-773e26fe1351 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-ea40496d-721b-4499-8479-7cb653d51811-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:43 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:43 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903
Sep 25 11:55:43 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:44 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2f2936b-be19-4fad-8c68-da803854a903" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-quobyte-a2f2936b-be19-4fad-8c68-da803854a903" released by "delete_volume" :: held 0.842s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:44 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 1073741824" returned: 0 in 0.553s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:44 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5
Sep 25 11:55:44 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Created reservations ['b363ee1e-d8f1-4b07-a2a1-d6df2ce3fd7a', 'f59130ed-25f1-4aff-9ee1-fb2ffe02916f', 'df234ef7-85ec-4f82-8b32-38be50a8bcf2', '11040680-d221-454a-aa84-b9e0b28d77b4'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:44 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:44 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:44 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d16c2b-556b-4540-ad3c-6db41ff90e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e28574-0b8b-4cbe-9e2a-f5883c8f6d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:44 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Volume volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 (d134cd56-f3c3-4aa7-af78-0ff7584f12a5): created successfully
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e28574-0b8b-4cbe-9e2a-f5883c8f6d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (a35dc8ef-ac03-4a93-bde3-9052002d32f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a4b146c2-5ed1-429c-b300-3d080cfbe2c2 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:55:44 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.289s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Deleted volume successfully.
Sep 25 11:55:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-62048e61-50ca-4ca7-a0da-bd3c80ea3717 tempest-CinderUnicodeTest-343819772 None] Lock "cinder-a2f2936b-be19-4fad-8c68-da803854a903-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-d134cd56-f3c3-4aa7-af78-0ff7584f12a5-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "cinder-d134cd56-f3c3-4aa7-af78-0ff7584f12a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25d131-9e57-4bfc-a5d7-6998cc83ce26]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:46 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5
Sep 25 11:55:46 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:46 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" returned: 0 in 0.474s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:46 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5
Sep 25 11:55:46 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:46 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" returned: 0 in 0.334s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-d134cd56-f3c3-4aa7-af78-0ff7584f12a5" released by "delete_volume" :: held 0.860s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Created reservations ['2be4c3a2-5888-4ab1-88cf-7c03e745981d', '4855753f-9b24-4c30-a83e-cafb4bfcff01', '541d6b74-0e17-4aa0-a3a8-78ba7a25d475', '1fe31885-d0bd-48eb-b410-4a142dc09e85'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:46 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:46 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-194019b6-92aa-4484-9106-bc79e575a367-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "cinder-194019b6-92aa-4484-9106-bc79e575a367-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-194019b6-92aa-4484-9106-bc79e575a367" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-194019b6-92aa-4484-9106-bc79e575a367" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da58d92-c2d1-4b2e-8d0b-0363959048d8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:47 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-047b9238-9f3e-444e-aa49-ddda9c758e61 tempest-VolumesGetTest-568231187 None] Lock "cinder-d134cd56-f3c3-4aa7-af78-0ff7584f12a5-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:47 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367
Sep 25 11:55:47 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:47 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367" returned: 0 in 0.427s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:47 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367
Sep 25 11:55:47 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:47 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-194019b6-92aa-4484-9106-bc79e575a367" returned: 0 in 0.271s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-194019b6-92aa-4484-9106-bc79e575a367" released by "delete_volume" :: held 0.770s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Created reservations ['f1d22884-d741-4f26-a3dc-969dbb8eb0e9', 'aec069a2-c60a-417a-8682-480905f5b8a3', '699fcc45-96e8-4ea4-9f5f-7b425efc1875', '09c4041d-9907-42e6-916c-f4f494533661'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:48 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:48 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:48 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9ba38b6d-f745-4e46-a13d-5f7a9c505793 tempest-VolumesGetTest-568231187 None] Lock "cinder-194019b6-92aa-4484-9106-bc79e575a367-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (c05a248d-e768-4ba5-8673-167cc7edd401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eb0b9d-c69c-485b-a447-e5e2be3fd55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eb0b9d-c69c-485b-a447-e5e2be3fd55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-45604471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11829df-72eb-46d6-930c-1d063dc637ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:49Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc628af-83f4-4779-b25d-6e687ca243e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc628af-83f4-4779-b25d-6e687ca243e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc3587c-37d3-4c88-9389-4d66896c075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc3587c-37d3-4c88-9389-4d66896c075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11829df-72eb-46d6-930c-1d063dc637ff', 'volume_name': 'volume-f11829df-72eb-46d6-930c-1d063dc637ff', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c838a4a-96da-460d-a9aa-c3f2f6278530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c838a4a-96da-460d-a9aa-c3f2f6278530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7ca1d5-b263-4624-80b2-ecbff4280fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Volume f11829df-72eb-46d6-930c-1d063dc637ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11829df-72eb-46d6-930c-1d063dc637ff', 'volume_size': 1}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-45604471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11829df-72eb-46d6-930c-1d063dc637ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:49Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Creating volume f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:55:48 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:55:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:48 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff 1073741824
Sep 25 11:55:48 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:49 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff 1073741824" returned: 0 in 0.540s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:49 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:55:49 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:49 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.305s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7ca1d5-b263-4624-80b2-ecbff4280fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11829df-72eb-46d6-930c-1d063dc637ff', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48221b6b-f19e-4bf9-86c8-2527949cde5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Volume volume-f11829df-72eb-46d6-930c-1d063dc637ff (f11829df-72eb-46d6-930c-1d063dc637ff): created successfully
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48221b6b-f19e-4bf9-86c8-2527949cde5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (c05a248d-e768-4ba5-8673-167cc7edd401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8578c7f1-147e-4ef9-a68c-6b4de87a1e77 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:51 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:55:51 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (5ef7e698-02c0-42b2-8a72-707706101345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f9663-2627-471b-8511-f1080da1c12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f9663-2627-471b-8511-f1080da1c12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-831038309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1a0815-d64c-4d97-90ea-434f0d6dbf9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f11829df-72eb-46d6-930c-1d063dc637ff,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:52Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce696aa-c3c9-4bc5-a936-7f0e348dedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce696aa-c3c9-4bc5-a936-7f0e348dedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c1c1be-719c-46a4-a2f8-3a9ed42c623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c1c1be-719c-46a4-a2f8-3a9ed42c623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7e1a0815-d64c-4d97-90ea-434f0d6dbf9d', 'volume_name': 'volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d', 'volume_size': 1, 'source_volid': 'f11829df-72eb-46d6-930c-1d063dc637ff', 'source_volstatus': 'available'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67aa5720-03aa-4c51-98a8-e18d3522b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67aa5720-03aa-4c51-98a8-e18d3522b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05df512d-82b5-4d0a-88a2-b8859c5455e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:55:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Volume 7e1a0815-d64c-4d97-90ea-434f0d6dbf9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d', 'volume_size': 1, 'source_volid': 'f11829df-72eb-46d6-930c-1d063dc637ff', 'source_volstatus': 'available'}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:51 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Cloning volume f11829df-72eb-46d6-930c-1d063dc637ff to volume 7e1a0815-d64c-4d97-90ea-434f0d6dbf9d
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Creating offline snapshot 7e963fde-e575-4948-b9be-c886f297fc60 of volume f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8ef7f3-f7cc-4f87-ac90-ecc253601b81]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:51 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.363s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:55:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:55:51 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:55:51 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:52 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:52 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 1G
Sep 25 11:55:52 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:52 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 1G" returned: 0 in 0.476s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11829df-72eb-46d6-930c-1d063dc637ff -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:52 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11829df-72eb-46d6-930c-1d063dc637ff -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:55:52 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:53 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11829df-72eb-46d6-930c-1d063dc637ff -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:53 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 is being set with open permissions: ugo+rw
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:53 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:55:53 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:53 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.256s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:53 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info
Sep 25 11:55:53 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:53 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:53 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info is being set with open permissions: ugo+rw
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:53 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info
Sep 25 11:55:53 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:53 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.info" returned: 0 in 0.278s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] snapshot: 7e963fde-e575-4948-b9be-c886f297fc60, volume: 7e1a0815-d64c-4d97-90ea-434f0d6dbf9d,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc7ce84-6930-4962-ae31-49dbdb0143fd]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:54 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:55:54 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:54 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.427s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f11829df-72eb-46d6-930c-1d063dc637ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08200a-8bb2-403f-b4af-5a420305c3fe]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:54 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:55:54 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:55:54 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.453s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:55:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:55:54 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d
Sep 25 11:55:54 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:00 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" returned: 0 in 6.078s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:00 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:56:00 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Converted 1024.00 MB image at 168.44 MB/s
Sep 25 11:56:00 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d is being set with open permissions: ugo+rw
Sep 25 11:56:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:00 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d
Sep 25 11:56:00 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:01 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" returned: 0 in 0.246s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" released by "_copy_volume_from_snapshot" :: held 7.286s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-7e963fde-e575-4948-b9be-c886f297fc60" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e963fde-e575-4948-b9be-c886f297fc60" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Deleting offline snapshot 7e963fde-e575-4948-b9be-c886f297fc60 of volume f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] snapshot_file for this snap is: volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2652b-28a4-4544-9310-fb3106d643a7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:01 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:56:01 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:01 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f11829df-72eb-46d6-930c-1d063dc637ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2d0c4-3850-4e83-b152-28243815a5dc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:01 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:56:01 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:02 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.594s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:02 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:56:02 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:02 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:02 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60
Sep 25 11:56:02 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:02 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff.7e963fde-e575-4948-b9be-c886f297fc60" returned: 0 in 0.289s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e963fde-e575-4948-b9be-c886f297fc60" released by "_delete_snapshot" :: held 1.780s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.333s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05df512d-82b5-4d0a-88a2-b8859c5455e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d', 'volume_size': 1, 'source_volid': 'f11829df-72eb-46d6-930c-1d063dc637ff', 'source_volstatus': 'available'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef647c3-d871-4281-a543-3eab41bd5e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Volume volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d (7e1a0815-d64c-4d97-90ea-434f0d6dbf9d): created successfully
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef647c3-d871-4281-a543-3eab41bd5e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (5ef7e698-02c0-42b2-8a72-707706101345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7179f39d-694e-4816-b564-d5c9445705e9 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (79bfba4a-3ba0-475c-92ab-dc044ddcb2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdbf6e5-a5dc-49bb-80fc-821f3c6ff8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdbf6e5-a5dc-49bb-80fc-821f3c6ff8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742438121',display_name='tempest-VolumesGetTest-Volume-796293007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b95c6e3-b9ab-4944-8b91-a7466712815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:04Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16d211f-78bf-42ee-a3a6-739ffa01e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16d211f-78bf-42ee-a3a6-739ffa01e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c9e832-499f-4b7e-a912-7ba15bb3eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c9e832-499f-4b7e-a912-7ba15bb3eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b95c6e3-b9ab-4944-8b91-a7466712815a', 'volume_name': 'volume-3b95c6e3-b9ab-4944-8b91-a7466712815a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b062fd-21ff-402e-8db9-87a3346162ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b062fd-21ff-402e-8db9-87a3346162ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65454b9-57ca-49e0-9047-e12a83ec5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Volume 3b95c6e3-b9ab-4944-8b91-a7466712815a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b95c6e3-b9ab-4944-8b91-a7466712815a', 'volume_size': 1}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742438121',display_name='tempest-VolumesGetTest-Volume-796293007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b95c6e3-b9ab-4944-8b91-a7466712815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:04Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Creating volume 3b95c6e3-b9ab-4944-8b91-a7466712815a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:56:04 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:04 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a 1073741824
Sep 25 11:56:04 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:04 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a 1073741824" returned: 0 in 0.446s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:04 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a
Sep 25 11:56:04 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:05 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65454b9-57ca-49e0-9047-e12a83ec5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b95c6e3-b9ab-4944-8b91-a7466712815a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ea8d5b-2e5f-4886-8f2c-8750daf3c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Volume volume-3b95c6e3-b9ab-4944-8b91-a7466712815a (3b95c6e3-b9ab-4944-8b91-a7466712815a): created successfully
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ea8d5b-2e5f-4886-8f2c-8750daf3c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (79bfba4a-3ba0-475c-92ab-dc044ddcb2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-17b8098c-5910-4b23-8ad6-7427470a3487 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-3b95c6e3-b9ab-4944-8b91-a7466712815a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "cinder-3b95c6e3-b9ab-4944-8b91-a7466712815a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-3b95c6e3-b9ab-4944-8b91-a7466712815a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-3b95c6e3-b9ab-4944-8b91-a7466712815a" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc6ae48-0829-4505-a60a-f1496969b257]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:06 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a
Sep 25 11:56:06 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:07 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:07 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a
Sep 25 11:56:07 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:07 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3b95c6e3-b9ab-4944-8b91-a7466712815a" returned: 0 in 0.302s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-3b95c6e3-b9ab-4944-8b91-a7466712815a" released by "delete_volume" :: held 0.781s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Created reservations ['2a8889fc-79e5-4713-b2c7-7c01b00ee6be', '83eb2484-799f-4965-9803-9a5be5cdda72', '1f25aa7c-b5d7-4bfe-a628-7270e642f517', '2597aff0-cad2-4c45-991f-9704bfb9b7f2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:07 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:07 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:07 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.277s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "cinder-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9c9f4300-00e3-44f8-b012-56a7db6ee807 tempest-VolumesGetTest-568231187 None] Lock "cinder-3b95c6e3-b9ab-4944-8b91-a7466712815a-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cecf655-0c83-4916-b300-657d4a876628]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:08 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d
Sep 25 11:56:08 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:08 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" returned: 0 in 0.494s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:08 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d
Sep 25 11:56:08 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:08 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d" released by "delete_volume" :: held 0.855s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Created reservations ['f5a37b77-57cf-4568-8894-d9bc2d2327ab', '63e4d5b4-efa3-4014-a39e-3f119621ecf9', 'ca232ecf-31b4-43f8-bad4-8bd03b4dc11b', '365b82c1-3cf2-4db1-9da0-c486f43160cd'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:08 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:08 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-f11829df-72eb-46d6-930c-1d063dc637ff-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "cinder-f11829df-72eb-46d6-930c-1d063dc637ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-f11829df-72eb-46d6-930c-1d063dc637ff" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-f11829df-72eb-46d6-930c-1d063dc637ff" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:09 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.364s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d4626e-e804-4e6a-b4ba-0344c6b438e3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ab3cc1ae-8041-426d-9153-c31f611ac94e tempest-VolumesGetTest-568231187 None] Lock "cinder-7e1a0815-d64c-4d97-90ea-434f0d6dbf9d-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:09 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:56:09 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:09 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:09 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff
Sep 25 11:56:09 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:10 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f11829df-72eb-46d6-930c-1d063dc637ff" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-f11829df-72eb-46d6-930c-1d063dc637ff" released by "delete_volume" :: held 0.860s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Created reservations ['7a6fd5d9-ffd2-4f1d-a6d6-285496c55a04', 'b3fa11d8-fa45-4972-aa8e-361f39b9b944', '974aeb84-9897-4482-9794-63e19e35c748', '9c5baba7-de0c-49e2-a720-cb32188a8566'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:10 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:10 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:10 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:56:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4ea0c010-3a52-47ec-8e4c-148decac7d91 tempest-VolumesGetTest-568231187 None] Lock "cinder-f11829df-72eb-46d6-930c-1d063dc637ff-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (18608575-411b-4178-971b-4841f3d73c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419fbe4-f773-46a3-b818-b0d5296ff492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419fbe4-f773-46a3-b818-b0d5296ff492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681379133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be49785d-0ba6-4e79-b8b4-7da7e2af126d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:11Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbafbd7-cc2b-4c7d-9090-32454ecf1cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbafbd7-cc2b-4c7d-9090-32454ecf1cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d6ed48-fc6a-45e6-b01c-89a3951cad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d6ed48-fc6a-45e6-b01c-89a3951cad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be49785d-0ba6-4e79-b8b4-7da7e2af126d', 'volume_name': 'volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc19d6a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d113c2e-4035-48b1-8db7-50b6bcddfd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d113c2e-4035-48b1-8db7-50b6bcddfd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb97d8e-15e6-4b45-b87e-3a9b96f9903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:11 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Volume be49785d-0ba6-4e79-b8b4-7da7e2af126d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc19d6a0>}
Sep 25 11:56:11 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Trying to clone be49785d-0ba6-4e79-b8b4-7da7e2af126d from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:56:12 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee80b6-f8a9-48b5-a302-74af1c47b5c8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:12 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD
Sep 25 11:56:12 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:12 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 is fetched for user 559d7b7333e949e1a2625ee43efff94e. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1089c-4f7f-4ef7-bafd-5d8e583f9938]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:12 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD
Sep 25 11:56:12 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:12 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681379133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be49785d-0ba6-4e79-b8b4-7da7e2af126d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:11Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Creating volume be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:56:12 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:56:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:12 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1073741824
Sep 25 11:56:12 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:13 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1073741824" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:13 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d
Sep 25 11:56:13 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:13 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d" returned: 0 in 0.258s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Attempting download of 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume be49785d-0ba6-4e79-b8b4-7da7e2af126d. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d79df-2a35-4de7-beb3-218336e673ea]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:13 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3
Sep 25 11:56:13 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:14 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3" returned: 0 in 0.349s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:14 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3
Sep 25 11:56:14 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:14 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3" returned: 1 in 0.360s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5646eeca-3c92-4e68-971d-05dbb021a3a9_xf6mjqe3' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966e328-81a6-4e83-b199-de3cd88c9569]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:14 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD
Sep 25 11:56:14 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:14 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] 5646eeca-3c92-4e68-971d-05dbb021a3a9 was qcow2, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:56:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:14 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d
Sep 25 11:56:14 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:16 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d" returned: 0 in 1.901s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:16 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5646eeca-3c92-4e68-971d-05dbb021a3a9_6702dezsdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:56:16 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Converted 112.00 MB image at 58.87 MB/s
Sep 25 11:56:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:16 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1G
Sep 25 11:56:16 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:17 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d 1G" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Downloaded image 5646eeca-3c92-4e68-971d-05dbb021a3a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}])) to volume be49785d-0ba6-4e79-b8b4-7da7e2af126d successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Temporary image 5646eeca-3c92-4e68-971d-05dbb021a3a9 for user 559d7b7333e949e1a2625ee43efff94e is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Marking volume be49785d-0ba6-4e79-b8b4-7da7e2af126d as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=82,cinder:INSERT=29,cinder:UPDATE=115,cinder:DELETE=13 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Copying metadata from image 5646eeca-3c92-4e68-971d-05dbb021a3a9 to be49785d-0ba6-4e79-b8b4-7da7e2af126d. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Creating volume glance metadata for volume be49785d-0ba6-4e79-b8b4-7da7e2af126d backed by image 5646eeca-3c92-4e68-971d-05dbb021a3a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=121,cinder:SELECT=82,cinder:DELETE=7,cinder:INSERT=29 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb97d8e-15e6-4b45-b87e-3a9b96f9903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d', 'volume_size': 1, 'image_id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5646eeca-3c92-4e68-971d-05dbb021a3a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99c5b9c6c5a14dd18c807956120e6e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5646eeca-3c92-4e68-971d-05dbb021a3a9', 'created_at': datetime.datetime(2026, 9, 25, 9, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5646eeca-3c92-4e68-971d-05dbb021a3a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc19d6a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0eac7-2717-4e99-9921-fd78642a4154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:17 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Volume volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d (be49785d-0ba6-4e79-b8b4-7da7e2af126d): created successfully
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0eac7-2717-4e99-9921-fd78642a4154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (18608575-411b-4178-971b-4841f3d73c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-30585d47-f034-49f5-9f58-074d4e09724c tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (7b185e7b-1ae9-4201-81b5-68b770f0584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec9bbce-ded7-4a9b-afe9-16b00989e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec9bbce-ded7-4a9b-afe9-16b00989e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690656253',display_name='tempest-VolumesGetTest-Volume-1942058663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195e3dfc-1c8a-4279-bd62-05a85882f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:18Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed0847d-4b00-4199-b82d-472171429198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed0847d-4b00-4199-b82d-472171429198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda378e-16a4-4860-a857-bcd5980dc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda378e-16a4-4860-a857-bcd5980dc520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195e3dfc-1c8a-4279-bd62-05a85882f6cd', 'volume_name': 'volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73985ab1-ac17-401c-91d5-19f0e7e60d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73985ab1-ac17-401c-91d5-19f0e7e60d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47063ad-a379-45dd-ac3a-2571649f6924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Volume 195e3dfc-1c8a-4279-bd62-05a85882f6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd', 'volume_size': 1}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690656253',display_name='tempest-VolumesGetTest-Volume-1942058663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195e3dfc-1c8a-4279-bd62-05a85882f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d7e8810e6c4e4cad4e07263e28c5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:18Z,use_quota=True,user_id='559d7b7333e949e1a2625ee43efff94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Creating volume 195e3dfc-1c8a-4279-bd62-05a85882f6cd {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:56:18 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:18 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd 1073741824
Sep 25 11:56:18 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:18 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd 1073741824" returned: 0 in 0.428s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:18 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd
Sep 25 11:56:18 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:19 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd" returned: 0 in 0.254s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47063ad-a379-45dd-ac3a-2571649f6924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2f4d1-c62d-4708-a18f-710844ac0e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Volume volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd (195e3dfc-1c8a-4279-bd62-05a85882f6cd): created successfully
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2f4d1-c62d-4708-a18f-710844ac0e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Flow 'volume_create_manager' (7b185e7b-1ae9-4201-81b5-68b770f0584a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-db95680a-76d5-43db-bc6c-c57e280fa457 tempest-VolumesGetTest-568231187 None] Created volume successfully.
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-195e3dfc-1c8a-4279-bd62-05a85882f6cd-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "cinder-195e3dfc-1c8a-4279-bd62-05a85882f6cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-195e3dfc-1c8a-4279-bd62-05a85882f6cd" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-195e3dfc-1c8a-4279-bd62-05a85882f6cd" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffe696-2fe9-4d35-ad4a-e3f30b631edb]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:19 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd
Sep 25 11:56:19 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:19 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:19 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd
Sep 25 11:56:19 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:20 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-195e3dfc-1c8a-4279-bd62-05a85882f6cd" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-195e3dfc-1c8a-4279-bd62-05a85882f6cd" released by "delete_volume" :: held 0.713s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Created reservations ['ed768543-d487-46b0-a5a0-8fbca10f0070', 'b5014733-94ff-4c68-adfb-856806be6bd0', 'f341fd31-7c16-4313-b1c9-7938af078c13', '06c5cdf6-46f2-4d1b-bf89-347da0a43dcf'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:20 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:20 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:20 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.266s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:20 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6eb36b75-6786-4f94-9017-35d156d8263a tempest-VolumesGetTest-568231187 None] Lock "cinder-195e3dfc-1c8a-4279-bd62-05a85882f6cd-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-be49785d-0ba6-4e79-b8b4-7da7e2af126d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "cinder-be49785d-0ba6-4e79-b8b4-7da7e2af126d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Acquiring lock "cinder-quobyte-be49785d-0ba6-4e79-b8b4-7da7e2af126d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-be49785d-0ba6-4e79-b8b4-7da7e2af126d" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49164d4-fa56-4d01-8c7d-cf8bffd9f0f5]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:20 devstack sudo[107238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d
Sep 25 11:56:20 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:21 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d" returned: 0 in 0.416s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:21 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d
Sep 25 11:56:21 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:21 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-be49785d-0ba6-4e79-b8b4-7da7e2af126d" returned: 0 in 0.278s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "cinder-quobyte-be49785d-0ba6-4e79-b8b4-7da7e2af126d" released by "delete_volume" :: held 0.737s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Created reservations ['b2979b8b-982f-4cf5-84ab-2becec01c3c0', '15b29b34-298b-47a3-a675-484f2c8b9023', '519070ee-fa9f-4436-9d1f-9ccc2f08bea7', 'bd999100-7f35-4fa6-a314-2fcf31790d2b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:21 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:21 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:21 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Deleted volume successfully.
Sep 25 11:56:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5f5bf61a-2663-4900-ac25-aebbaf722dab tempest-VolumesGetTest-568231187 None] Lock "cinder-be49785d-0ba6-4e79-b8b4-7da7e2af126d-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Flow 'volume_create_manager' (74ede6bf-9f74-4695-b6b6-c3463e704f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb3f5a-3eeb-482b-8a0d-001032f82ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb3f5a-3eeb-482b-8a0d-001032f82ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1654150126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eaab88-8ea0-45c1-8110-93a1638cbc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49d2b239b164271948a72878833e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:26Z,use_quota=True,user_id='629a5e72bff34b12a515b1fe9003d654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ead5066-4fef-4cb2-9a3e-5858a7d8a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ead5066-4fef-4cb2-9a3e-5858a7d8a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb6d224-f2fb-447a-b9f1-a8ef5c70eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb6d224-f2fb-447a-b9f1-a8ef5c70eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67eaab88-8ea0-45c1-8110-93a1638cbc2c', 'volume_name': 'volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d25fc6-b2d8-404f-8e47-0222aac0e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d25fc6-b2d8-404f-8e47-0222aac0e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7955d18-552e-447b-bd07-7ad7ffd9814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c', 'volume_size': 1}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1654150126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eaab88-8ea0-45c1-8110-93a1638cbc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49d2b239b164271948a72878833e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:26Z,use_quota=True,user_id='629a5e72bff34b12a515b1fe9003d654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Creating volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:56:26 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:26 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c 1073741824
Sep 25 11:56:26 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:26 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c 1073741824" returned: 0 in 0.531s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:26 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c
Sep 25 11:56:26 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:27 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c" returned: 0 in 0.275s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7955d18-552e-447b-bd07-7ad7ffd9814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3146a05a-8290-4e19-9a93-a3f96ea5d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Volume volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c (67eaab88-8ea0-45c1-8110-93a1638cbc2c): created successfully
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3146a05a-8290-4e19-9a93-a3f96ea5d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Flow 'volume_create_manager' (74ede6bf-9f74-4695-b6b6-c3463e704f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d04b187a-3123-4ac0-8b81-70ef17f02fdc tempest-VolumesSnapshotListTestJSON-1329257697 None] Created volume successfully.
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Creating offline snapshot 70d807ca-dfe4-4440-bc71-881335cb6e61 of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[238f5f22-504d-4db1-b626-be480563ef86]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:28 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c
Sep 25 11:56:28 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:28 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c" returned: 0 in 0.382s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:28 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 1G
Sep 25 11:56:28 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:29 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 1G" returned: 0 in 0.417s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:29 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:29 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:29 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.302s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:29 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 is being set with open permissions: ugo+rw
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:29 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:29 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:29 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.248s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:29 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info
Sep 25 11:56:29 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:30 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:30 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info is being set with open permissions: ugo+rw
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:30 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info
Sep 25 11:56:30 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:30 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.info" returned: 0 in 0.260s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ead83433-4394-402f-b08a-d50b8d0888d5 tempest-VolumesSnapshotListTestJSON-1329257697 None] Create snapshot completed successfully
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Creating offline snapshot b250e151-e972-433a-ae10-da35342c80ab of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1ec5d-b73e-470a-af30-82505f3b8271]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:30 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:30 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:31 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.399s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:31 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab 1G
Sep 25 11:56:31 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:31 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab 1G" returned: 0 in 0.492s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:31 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:31 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:31 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:31 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab is being set with open permissions: ugo+rw
Sep 25 11:56:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:31 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:31 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:32 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.600s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-adffa433-6d63-4f40-9f7e-80c1bd65a0a8 tempest-VolumesSnapshotListTestJSON-1329257697 None] Create snapshot completed successfully
Sep 25 11:56:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Creating offline snapshot f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[72685e24-dfc2-44e0-a126-34308be027e1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:33 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:33 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:33 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:33 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 1G
Sep 25 11:56:33 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:33 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 1G" returned: 0 in 0.508s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:34 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614
Sep 25 11:56:34 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:34 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" returned: 0 in 0.323s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:34 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 is being set with open permissions: ugo+rw
Sep 25 11:56:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:34 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614
Sep 25 11:56:34 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:34 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" returned: 0 in 0.273s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.621s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:34 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3054815a-4e42-4049-82be-033c64610830 tempest-VolumesSnapshotListTestJSON-1329257697 None] Create snapshot completed successfully
Sep 25 11:56:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Deleting offline snapshot f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] snapshot_file for this snap is: volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa74c50-5a85-41f5-afe4-52f7e2efb071]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:36 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614
Sep 25 11:56:36 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" returned: 0 in 0.390s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6658669-e588-4210-8fe3-55a0b66aa3ce]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:36 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:36 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:36 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:36 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614
Sep 25 11:56:36 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:37 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:37 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614
Sep 25 11:56:37 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:37 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" returned: 0 in 0.272s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614" released by "_delete_snapshot" :: held 1.584s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" released by "delete_snapshot" :: held 1.610s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Created reservations ['3f41dfd3-6aba-441e-83e5-00ad471d3cce', '12b03ab0-178b-4985-88eb-6c5410677b4e', 'a53165fc-32ae-4c2d-bb60-b8f2cee5c68a', '1cc88b9f-b7b2-4c28-babc-5e2a67d9a8f8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Delete snapshot completed successfully.
Sep 25 11:56:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8826d9ed-b160-4b45-9b48-4d98b8223330 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-f3fca8a3-7ac8-49bc-bc31-1cfa4d798614-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-b250e151-e972-433a-ae10-da35342c80ab-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-b250e151-e972-433a-ae10-da35342c80ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-b250e151-e972-433a-ae10-da35342c80ab" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-b250e151-e972-433a-ae10-da35342c80ab" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Deleting offline snapshot b250e151-e972-433a-ae10-da35342c80ab of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] snapshot_file for this snap is: volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b142a8b8-c500-4fad-90c0-0bb7e5c3df15]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:38 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:38 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:38 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.466s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d8127-0ec8-4a3f-99c1-8d358ee71149]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:38 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:38 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:39 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:39 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:39 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:39 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:39 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab
Sep 25 11:56:39 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:40 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.b250e151-e972-433a-ae10-da35342c80ab" returned: 0 in 0.314s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-b250e151-e972-433a-ae10-da35342c80ab" released by "_delete_snapshot" :: held 1.820s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" released by "delete_snapshot" :: held 1.852s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Created reservations ['f4d93330-f2ed-4dce-b66f-db3bf40e667e', '7448adfc-7cdb-4dd2-8c2e-aa3f0247bd50', 'c67534ba-66ce-4bfb-960d-5d9e95d5752d', 'a899d807-6e35-43db-9a1a-bb0c44c17971'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Delete snapshot completed successfully.
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad04d8af-e3d6-49c8-9a86-46ed0ae06e46 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-b250e151-e972-433a-ae10-da35342c80ab-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-70d807ca-dfe4-4440-bc71-881335cb6e61-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-70d807ca-dfe4-4440-bc71-881335cb6e61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-70d807ca-dfe4-4440-bc71-881335cb6e61" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-70d807ca-dfe4-4440-bc71-881335cb6e61" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Deleting offline snapshot 70d807ca-dfe4-4440-bc71-881335cb6e61 of volume 67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] snapshot_file for this snap is: volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[20531255-6a0b-44ee-bb79-847bf960ebac]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:40 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:40 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:40 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.406s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116d4db-5e11-4dfd-ad24-fab4ae9b7e7f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:41 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c
Sep 25 11:56:41 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:41 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c" returned: 0 in 0.418s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:41 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:41 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:41 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.368s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:41 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61
Sep 25 11:56:41 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:41 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c.70d807ca-dfe4-4440-bc71-881335cb6e61" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-70d807ca-dfe4-4440-bc71-881335cb6e61" released by "_delete_snapshot" :: held 1.622s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" released by "delete_snapshot" :: held 1.648s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Created reservations ['a48831e9-1373-4559-93e9-2d5abe176c76', 'e7872273-6be5-47bf-bf1b-fb5df060675a', 'd83e3e2e-425c-45a8-affc-11d0b64d9fdc', '9d9dc1b9-c29d-4d6c-a020-5dfdfe339326'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Delete snapshot completed successfully.
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-afb69846-a029-4dc3-8882-a6b8d1c315a1 tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-70d807ca-dfe4-4440-bc71-881335cb6e61-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-67eaab88-8ea0-45c1-8110-93a1638cbc2c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-67eaab88-8ea0-45c1-8110-93a1638cbc2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[91078c93-71cb-4c85-9ee9-07fa387c146d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:42 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c
Sep 25 11:56:42 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:43 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:43 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c
Sep 25 11:56:43 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:43 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-67eaab88-8ea0-45c1-8110-93a1638cbc2c" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-quobyte-67eaab88-8ea0-45c1-8110-93a1638cbc2c" released by "delete_volume" :: held 0.781s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Created reservations ['56d0ceec-3608-4852-857e-a3db478a0a80', '5b74cc04-2614-47d4-8e29-60e1b90127bf', '68ce8e45-d4d4-47cf-aeab-05333cf37065', 'e4b054c5-a0aa-4243-8f66-8f4e58eb106e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:43 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:43 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:43 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Deleted volume successfully.
Sep 25 11:56:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8ec23c4e-c074-4486-add0-8970f5efa2ff tempest-VolumesSnapshotListTestJSON-1329257697 None] Lock "cinder-67eaab88-8ea0-45c1-8110-93a1638cbc2c-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Flow 'volume_create_manager' (b727c0e5-7c68-4032-9cfe-7c3ffc3330e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e613d722-af3a-4a44-914e-c20074fdff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e613d722-af3a-4a44-914e-c20074fdff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24ec28a-6d12-4fd4-adda-329655a7f62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e35b4989ed4b9696907dea090c43fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:51Z,use_quota=True,user_id='6a7d33ae8e9a4f2d80ca8e4cbd32325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c661aa-e1ea-4d25-a2b7-209a79f81e68),volume_type_id=02c661aa-e1ea-4d25-a2b7-209a79f81e68)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cabe7b-e339-46f4-aeb4-79d7a8c86a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cabe7b-e339-46f4-aeb4-79d7a8c86a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9ca3e1-337c-4958-92a2-f623a87a28d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:51 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:51 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9ca3e1-337c-4958-92a2-f623a87a28d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b24ec28a-6d12-4fd4-adda-329655a7f62e', 'volume_name': 'volume-b24ec28a-6d12-4fd4-adda-329655a7f62e', 'volume_size': 1, 'image_id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09f532dd5485964cfb2046b2824a67a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9e35b4989ed4b9696907dea090c43fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71c7af7764506c748220e29db488ed393ef752726c721b19a42609db7a45ae49f3975f28a0f4fdc23c8c0bafa521eba8932c8d63901edf418cc9371cc796b259', 'id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc0a4d40>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5509cf0e-c074-4578-ae29-d00f1ba0f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5509cf0e-c074-4578-ae29-d00f1ba0f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5134d002-9c45-46d2-85b8-0937b0ae0b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Volume b24ec28a-6d12-4fd4-adda-329655a7f62e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b24ec28a-6d12-4fd4-adda-329655a7f62e', 'volume_size': 1, 'image_id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09f532dd5485964cfb2046b2824a67a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9e35b4989ed4b9696907dea090c43fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71c7af7764506c748220e29db488ed393ef752726c721b19a42609db7a45ae49f3975f28a0f4fdc23c8c0bafa521eba8932c8d63901edf418cc9371cc796b259', 'id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc0a4d40>}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Trying to clone b24ec28a-6d12-4fd4-adda-329655a7f62e from image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e at location (None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:56:51 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:56:51 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbcadd-7ed8-4f92-bf42-d4dfa3881dd7]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:52 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:52 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:52 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:52 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:52 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:52 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Temporary image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e is fetched for user 6a7d33ae8e9a4f2d80ca8e4cbd32325f. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf21a9-b4d9-4764-9c82-992479c3fcd6]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:52 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:52 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:53 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:53 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:53 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:53 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24ec28a-6d12-4fd4-adda-329655a7f62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e35b4989ed4b9696907dea090c43fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:51Z,use_quota=True,user_id='6a7d33ae8e9a4f2d80ca8e4cbd32325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c661aa-e1ea-4d25-a2b7-209a79f81e68),volume_type_id=02c661aa-e1ea-4d25-a2b7-209a79f81e68)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Creating volume b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:56:53 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:53 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1073741824
Sep 25 11:56:53 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:53 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1073741824" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:54 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e
Sep 25 11:56:54 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:54 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e" returned: 0 in 0.279s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Attempting download of cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e ((None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}])) to volume b24ec28a-6d12-4fd4-adda-329655a7f62e. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[19898b37-fdb6-46b8-9e13-12e2d2ebf9c2]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:54 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5
Sep 25 11:56:54 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:54 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:54 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5
Sep 25 11:56:54 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:55 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5" returned: 1 in 0.344s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_5fwjsai5' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ca1af-551c-45a6-a07d-1a6a022caa6c]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:55 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:55 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:55 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:55 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD
Sep 25 11:56:55 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:55 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e was raw, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:56:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:55 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e
Sep 25 11:56:55 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:56 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e" returned: 0 in 0.495s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e_uhqqpwcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:56:56 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:56 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1G
Sep 25 11:56:56 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:56 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e 1G" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Downloaded image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e ((None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}])) to volume b24ec28a-6d12-4fd4-adda-329655a7f62e successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Temporary image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e for user 6a7d33ae8e9a4f2d80ca8e4cbd32325f is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Marking volume b24ec28a-6d12-4fd4-adda-329655a7f62e as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Copying metadata from image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e to b24ec28a-6d12-4fd4-adda-329655a7f62e. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Creating volume glance metadata for volume b24ec28a-6d12-4fd4-adda-329655a7f62e backed by image cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '09f532dd5485964cfb2046b2824a67a1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5134d002-9c45-46d2-85b8-0937b0ae0b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24ec28a-6d12-4fd4-adda-329655a7f62e', 'volume_size': 1, 'image_id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09f532dd5485964cfb2046b2824a67a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9e35b4989ed4b9696907dea090c43fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71c7af7764506c748220e29db488ed393ef752726c721b19a42609db7a45ae49f3975f28a0f4fdc23c8c0bafa521eba8932c8d63901edf418cc9371cc796b259', 'id': 'cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd90ce3-5041-4e1b-af8a-b45c7bcf1b8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cc0a4d40>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c64da7e-1f9a-4191-a051-3a05d2bd8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:56:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Volume volume-b24ec28a-6d12-4fd4-adda-329655a7f62e (b24ec28a-6d12-4fd4-adda-329655a7f62e): created successfully
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c64da7e-1f9a-4191-a051-3a05d2bd8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:56:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Flow 'volume_create_manager' (b727c0e5-7c68-4032-9cfe-7c3ffc3330e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:56:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7cb39d50-e041-48f1-b531-725ca66d0809 tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Created volume successfully.
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Acquiring lock "cinder-b24ec28a-6d12-4fd4-adda-329655a7f62e-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "cinder-b24ec28a-6d12-4fd4-adda-329655a7f62e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Acquiring lock "cinder-quobyte-b24ec28a-6d12-4fd4-adda-329655a7f62e" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "cinder-quobyte-b24ec28a-6d12-4fd4-adda-329655a7f62e" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114dcd5-437d-40e1-908e-7eb19101a31c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:56:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:58 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e
Sep 25 11:56:58 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:58 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e" returned: 0 in 0.398s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:58 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e
Sep 25 11:56:58 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:58 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b24ec28a-6d12-4fd4-adda-329655a7f62e" returned: 0 in 0.315s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "cinder-quobyte-b24ec28a-6d12-4fd4-adda-329655a7f62e" released by "delete_volume" :: held 0.773s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:56:58 devstack cinder-volume[87358]: WARNING cinder.quota [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:56:58 devstack cinder-volume[87358]: WARNING cinder.quota [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Created reservations ['906355c5-3c86-4f7c-9271-b10d4f4cfe95', '1d1ff7de-bdec-4cb1-a01b-bb2af35a3b9e', '24351550-2df1-40e1-9f9c-61899c582f38', '15a22c80-6d2f-4dcd-a816-faeb723abbc8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:56:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:56:58 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:56:58 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:56:59 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 25 11:56:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:56:59 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:56:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Deleted volume successfully.
Sep 25 11:56:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c6c3ba7b-7147-4337-8cac-8001196e2cae tempest-VolumeAndVolumeTypeFromImageTest-39605573 None] Lock "cinder-b24ec28a-6d12-4fd4-adda-329655a7f62e-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (b914157b-f340-4de0-83b0-60c31df623ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8783544-807c-4cd8-b2f2-ae17b69f45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8783544-807c-4cd8-b2f2-ae17b69f45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318151596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eefcb0c-5522-44d5-a94a-a99df4f39c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:04Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a71beb2-47e2-4794-800b-9588b4f03f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a71beb2-47e2-4794-800b-9588b4f03f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de59bf38-e9db-439e-aaf8-414060aec98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de59bf38-e9db-439e-aaf8-414060aec98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eefcb0c-5522-44d5-a94a-a99df4f39c14', 'volume_name': 'volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44646ed-83cb-4d43-88f8-cdc695317c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44646ed-83cb-4d43-88f8-cdc695317c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b8eeab-7644-41e9-b776-1ba342b12e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Volume 8eefcb0c-5522-44d5-a94a-a99df4f39c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14', 'volume_size': 1}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318151596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eefcb0c-5522-44d5-a94a-a99df4f39c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:04Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Creating volume 8eefcb0c-5522-44d5-a94a-a99df4f39c14 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:04 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:04 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 1073741824
Sep 25 11:57:04 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (fc509c40-a83b-435e-8e8e-b952b018ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af518b42-55a9-4f68-a15c-c259f6f17d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af518b42-55a9-4f68-a15c-c259f6f17d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192151405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea5190f-1f76-488f-98cb-37022c1f3ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:04Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde9e0bd-2c17-4c03-8094-0dc888775fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde9e0bd-2c17-4c03-8094-0dc888775fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f0c8fe-eeab-4de1-9b73-1ffd262f040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f0c8fe-eeab-4de1-9b73-1ffd262f040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea5190f-1f76-488f-98cb-37022c1f3ca1', 'volume_name': 'volume-dea5190f-1f76-488f-98cb-37022c1f3ca1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67aa43c-8e27-49f1-9548-1b6e971913a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67aa43c-8e27-49f1-9548-1b6e971913a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8701f603-b43c-4536-a1c9-a800505938b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Volume dea5190f-1f76-488f-98cb-37022c1f3ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea5190f-1f76-488f-98cb-37022c1f3ca1', 'volume_size': 1}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:04 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 1073741824" returned: 0 in 0.601s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:04 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14
Sep 25 11:57:04 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (fccbe267-9ae1-42a4-a36b-30bd0f705236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7827a7-f4db-4023-b39a-80f7f3573160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7827a7-f4db-4023-b39a-80f7f3573160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263491092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03512a08-c2e0-4d96-8f77-6cdae4dddd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:05Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20501ad3-7c26-4c43-a408-2fc96a01e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20501ad3-7c26-4c43-a408-2fc96a01e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff56861-f1b4-4691-8175-2d453109ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff56861-f1b4-4691-8175-2d453109ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03512a08-c2e0-4d96-8f77-6cdae4dddd47', 'volume_name': 'volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161cde4b-69e8-4fcf-ab59-8306715a321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161cde4b-69e8-4fcf-ab59-8306715a321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11dc964-3177-45fe-b655-7c425983e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:04 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Volume 03512a08-c2e0-4d96-8f77-6cdae4dddd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47', 'volume_size': 1}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:04 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14" returned: 0 in 0.320s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192151405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea5190f-1f76-488f-98cb-37022c1f3ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:04Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Creating volume dea5190f-1f76-488f-98cb-37022c1f3ca1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:04 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b8eeab-7644-41e9-b776-1ba342b12e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b01f47a-85db-4d79-aa00-09f20a5eab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 1073741824
Sep 25 11:57:05 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Volume volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 (8eefcb0c-5522-44d5-a94a-a99df4f39c14): created successfully
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b01f47a-85db-4d79-aa00-09f20a5eab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (b914157b-f340-4de0-83b0-60c31df623ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5458fc70-07e4-4e49-824b-67a05552cfc3 tempest-CreateVolumesFromImageTest-484536603 None] Created volume successfully.
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (ae4dedce-e82b-4d49-8993-a18eb9872a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da0db6-fabc-4254-948d-8cd60c36e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da0db6-fabc-4254-948d-8cd60c36e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732855968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbcdfd3-56d2-43ea-8423-37f400f4759c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:05Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f301bd8-49bb-4048-b41d-aebe053c7dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f301bd8-49bb-4048-b41d-aebe053c7dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b099bf-dfa6-4b60-8bdd-99ad73e99be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b099bf-dfa6-4b60-8bdd-99ad73e99be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbcdfd3-56d2-43ea-8423-37f400f4759c', 'volume_name': 'volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7921dc26-0ad0-4b8b-aa15-05af11cb9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7921dc26-0ad0-4b8b-aa15-05af11cb9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1092c-c3df-43fe-8ded-5e6d4cfe183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Volume 1cbcdfd3-56d2-43ea-8423-37f400f4759c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c', 'volume_size': 1}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:05 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 1073741824" returned: 0 in 0.660s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:05 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1
Sep 25 11:57:05 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (c140dcd0-3191-4c14-8360-be8f1985eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45e1c4f-9a47-4161-934a-1290b1d5bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45e1c4f-9a47-4161-934a-1290b1d5bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028309681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a39c4b-d3fb-40a0-b053-cfd44467d30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:06Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdddfb96-83a2-42fb-ba16-e3ff4944b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdddfb96-83a2-42fb-ba16-e3ff4944b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8eda60-1292-4d64-8edf-020e5372470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8eda60-1292-4d64-8edf-020e5372470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a39c4b-d3fb-40a0-b053-cfd44467d30c', 'volume_name': 'volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e5da05-b605-4280-875f-70c596ba5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e5da05-b605-4280-875f-70c596ba5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73850eb3-0aee-412b-8e0f-9835a72b6212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Volume 37a39c4b-d3fb-40a0-b053-cfd44467d30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c', 'volume_size': 1}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:05 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1" returned: 0 in 0.288s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263491092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03512a08-c2e0-4d96-8f77-6cdae4dddd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:05Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Creating volume 03512a08-c2e0-4d96-8f77-6cdae4dddd47 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:06 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 1073741824
Sep 25 11:57:06 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8701f603-b43c-4536-a1c9-a800505938b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea5190f-1f76-488f-98cb-37022c1f3ca1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551fc090-90ad-4894-9a76-c968080380a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Volume volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 (dea5190f-1f76-488f-98cb-37022c1f3ca1): created successfully
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551fc090-90ad-4894-9a76-c968080380a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (fc509c40-a83b-435e-8e8e-b952b018ff63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f3b58e4c-2ea8-41ed-a084-6279f99af71f tempest-CreateVolumesFromImageTest-484536603 None] Created volume successfully.
Sep 25 11:57:06 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 1073741824" returned: 0 in 0.468s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:06 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47
Sep 25 11:57:06 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:06 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47" returned: 0 in 0.287s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732855968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbcdfd3-56d2-43ea-8423-37f400f4759c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:05Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Creating volume 1cbcdfd3-56d2-43ea-8423-37f400f4759c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:06 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c 1073741824
Sep 25 11:57:06 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11dc964-3177-45fe-b655-7c425983e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f01b8-b226-4ed0-a083-3ce537899314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Volume volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 (03512a08-c2e0-4d96-8f77-6cdae4dddd47): created successfully
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f01b8-b226-4ed0-a083-3ce537899314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (fccbe267-9ae1-42a4-a36b-30bd0f705236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fea9261e-be12-410f-ae5d-6d80ba2df44f tempest-CreateVolumesFromImageTest-484536603 None] Created volume successfully.
Sep 25 11:57:07 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c 1073741824" returned: 0 in 0.480s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:07 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c
Sep 25 11:57:07 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:07 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c" returned: 0 in 0.263s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028309681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a39c4b-d3fb-40a0-b053-cfd44467d30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b200c84a17a4c7e8f6fcc761b06c68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:06Z,use_quota=True,user_id='ad072f74a92141ea9da63f4d0a9f692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Creating volume 37a39c4b-d3fb-40a0-b053-cfd44467d30c {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:07 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:07 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c 1073741824
Sep 25 11:57:07 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1092c-c3df-43fe-8ded-5e6d4cfe183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d25114a-0e89-488d-b83f-f79c4fc854a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Volume volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c (1cbcdfd3-56d2-43ea-8423-37f400f4759c): created successfully
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d25114a-0e89-488d-b83f-f79c4fc854a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (ae4dedce-e82b-4d49-8993-a18eb9872a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9b759fa8-ccec-46eb-992e-48120a3ef0b9 tempest-CreateVolumesFromImageTest-484536603 None] Created volume successfully.
Sep 25 11:57:08 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c 1073741824" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:08 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c
Sep 25 11:57:08 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:08 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73850eb3-0aee-412b-8e0f-9835a72b6212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfc656e-c9bb-4868-8af9-56ef6622d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:08 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Volume volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c (37a39c4b-d3fb-40a0-b053-cfd44467d30c): created successfully
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfc656e-c9bb-4868-8af9-56ef6622d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Flow 'volume_create_manager' (c140dcd0-3191-4c14-8360-be8f1985eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bdb88b21-bdc2-4295-9e41-072d34870f94 tempest-CreateVolumesFromImageTest-484536603 None] Created volume successfully.
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-37a39c4b-d3fb-40a0-b053-cfd44467d30c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-37a39c4b-d3fb-40a0-b053-cfd44467d30c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-quobyte-37a39c4b-d3fb-40a0-b053-cfd44467d30c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-37a39c4b-d3fb-40a0-b053-cfd44467d30c" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[21de6659-96ec-4aea-8eae-6a5afe87830d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:09 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c
Sep 25 11:57:09 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:09 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c" returned: 0 in 0.412s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:09 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c
Sep 25 11:57:09 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:10 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37a39c4b-d3fb-40a0-b053-cfd44467d30c" returned: 0 in 0.260s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-37a39c4b-d3fb-40a0-b053-cfd44467d30c" released by "delete_volume" :: held 0.720s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Created reservations ['22d23e9e-16e8-4d6a-9284-25f2fdc3abc7', '650f5e1a-5322-4007-8462-5dbd45277f0e', '3e4abca1-b814-4fb6-8d90-ace75f08162c', 'fd3c26b9-eb37-4b8e-bae9-a5b8a8e665ec'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:10 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:10 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-1cbcdfd3-56d2-43ea-8423-37f400f4759c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:10 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.272s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Deleted volume successfully.
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-1cbcdfd3-56d2-43ea-8423-37f400f4759c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bfa30aa8-f3a3-413b-a9c7-a682341fe957 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-37a39c4b-d3fb-40a0-b053-cfd44467d30c-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-quobyte-1cbcdfd3-56d2-43ea-8423-37f400f4759c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-1cbcdfd3-56d2-43ea-8423-37f400f4759c" acquired by "delete_volume" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c8eabf-85b7-4530-a0b3-96080d417fda]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:10 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c
Sep 25 11:57:10 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:11 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c" returned: 0 in 0.384s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:11 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c
Sep 25 11:57:11 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:11 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-1cbcdfd3-56d2-43ea-8423-37f400f4759c" returned: 0 in 0.261s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-1cbcdfd3-56d2-43ea-8423-37f400f4759c" released by "delete_volume" :: held 0.688s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Created reservations ['60391ba9-4cc3-4a7c-995d-c36a44e1e9e7', '91e7e988-e8fc-4c0d-b1e0-bdd436789e43', '79f1aaca-6354-4929-ac63-a52e79bcfcbb', '7ce568f8-f9ea-449f-bc93-a1e3200df5e0'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:11 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:11 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:11 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-03512a08-c2e0-4d96-8f77-6cdae4dddd47-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Deleted volume successfully.
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-03512a08-c2e0-4d96-8f77-6cdae4dddd47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2e9c6b0e-61a4-4c01-8884-527c75810605 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-1cbcdfd3-56d2-43ea-8423-37f400f4759c-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-quobyte-03512a08-c2e0-4d96-8f77-6cdae4dddd47" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-03512a08-c2e0-4d96-8f77-6cdae4dddd47" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362c2dd-88c7-4927-acd1-ab99c8e52f1e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:11 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47
Sep 25 11:57:11 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:12 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:12 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47
Sep 25 11:57:12 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:12 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03512a08-c2e0-4d96-8f77-6cdae4dddd47" returned: 0 in 0.263s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-03512a08-c2e0-4d96-8f77-6cdae4dddd47" released by "delete_volume" :: held 0.689s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Created reservations ['c4593a6c-74c0-49c1-bf22-bc7b43cb9b64', '0fa3050d-c2ad-405c-b9e0-936964a65a63', '90ed5d15-ba15-4eb4-8119-1d875d187637', '04eeacd8-d911-4b62-863f-56b75c30f73e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:12 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:12 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:12 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-dea5190f-1f76-488f-98cb-37022c1f3ca1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.271s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Deleted volume successfully.
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-dea5190f-1f76-488f-98cb-37022c1f3ca1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-93da0921-2033-4e3b-b1c1-f45c6c767462 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-03512a08-c2e0-4d96-8f77-6cdae4dddd47-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-quobyte-dea5190f-1f76-488f-98cb-37022c1f3ca1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-dea5190f-1f76-488f-98cb-37022c1f3ca1" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f30f1-3d15-45b9-9f01-1f9e43829f4c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:13 devstack sudo[107581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1
Sep 25 11:57:13 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:13 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:13 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1
Sep 25 11:57:13 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:13 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dea5190f-1f76-488f-98cb-37022c1f3ca1" returned: 0 in 0.247s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-dea5190f-1f76-488f-98cb-37022c1f3ca1" released by "delete_volume" :: held 0.706s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Created reservations ['6c485f75-08eb-45cf-82f5-a71171a7e7fb', '23119268-6a99-4670-86b0-d86b160ec6a1', 'fb8ecd6d-4687-47e9-85e1-48e714844f8f', 'd749787d-d7a3-434b-8edb-7e8020afe855'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:13 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:13 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:14 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.262s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Deleted volume successfully.
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-8eefcb0c-5522-44d5-a94a-a99df4f39c14-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-8eefcb0c-5522-44d5-a94a-a99df4f39c14-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8af11466-2482-45ab-826a-dc308aafcc90 tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-dea5190f-1f76-488f-98cb-37022c1f3ca1-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "cinder-quobyte-8eefcb0c-5522-44d5-a94a-a99df4f39c14" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-8eefcb0c-5522-44d5-a94a-a99df4f39c14" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace8d9ab-2195-4d9e-ad6e-07f61324e9e0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:14 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14
Sep 25 11:57:14 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:14 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14" returned: 0 in 0.436s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:14 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14
Sep 25 11:57:14 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:14 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8eefcb0c-5522-44d5-a94a-a99df4f39c14" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-quobyte-8eefcb0c-5522-44d5-a94a-a99df4f39c14" released by "delete_volume" :: held 0.785s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Created reservations ['fc7ac0cc-cd36-4440-955c-0a523856902a', 'e5bbf377-a92d-4f66-9672-3e134e5b2251', '2504147f-8190-456c-855c-ae4cb29146b2', 'fcac567c-97b4-4c62-9afe-b560c6945a44'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:15 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:15 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:15 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Deleted volume successfully.
Sep 25 11:57:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-131b84a7-31d1-43f7-906a-caf0e5dc09ff tempest-CreateVolumesFromImageTest-484536603 None] Lock "cinder-8eefcb0c-5522-44d5-a94a-a99df4f39c14-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=93,cinder:INSERT=45,cinder:UPDATE=118,cinder:DELETE=14 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:INSERT=34,cinder:SELECT=101,cinder:UPDATE=122,cinder:DELETE=7 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (faa8f7a8-d53f-4e41-a8ea-fc7a83c588f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60650f36-a893-46f6-9527-6ba65880591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60650f36-a893-46f6-9527-6ba65880591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2035452990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7529d8f-470f-4dab-9412-a4922cd85be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:19Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c328d-1ee8-4460-aa1f-3dde9f77e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c328d-1ee8-4460-aa1f-3dde9f77e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab453664-ceb6-4ed6-9c5e-e5286deaa2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab453664-ceb6-4ed6-9c5e-e5286deaa2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7529d8f-470f-4dab-9412-a4922cd85be1', 'volume_name': 'volume-f7529d8f-470f-4dab-9412-a4922cd85be1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06151df-be70-49c8-8870-c6873b40c79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06151df-be70-49c8-8870-c6873b40c79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2564c196-f80b-4600-9618-568731d577a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Volume f7529d8f-470f-4dab-9412-a4922cd85be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7529d8f-470f-4dab-9412-a4922cd85be1', 'volume_size': 1}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2035452990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7529d8f-470f-4dab-9412-a4922cd85be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:19Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Creating volume f7529d8f-470f-4dab-9412-a4922cd85be1 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:19 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:19 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 1073741824
Sep 25 11:57:19 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:19 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 1073741824" returned: 0 in 0.459s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:19 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1
Sep 25 11:57:20 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:20 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2564c196-f80b-4600-9618-568731d577a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7529d8f-470f-4dab-9412-a4922cd85be1', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a371ea9d-9ae0-4973-9783-e6538db75895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Volume volume-f7529d8f-470f-4dab-9412-a4922cd85be1 (f7529d8f-470f-4dab-9412-a4922cd85be1): created successfully
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a371ea9d-9ae0-4973-9783-e6538db75895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (faa8f7a8-d53f-4e41-a8ea-fc7a83c588f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:20 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4ee10bdc-4d99-4c0e-96e0-eae2c5933754 tempest-ProjectReaderTests-50674499 None] Created volume successfully.
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-f7529d8f-470f-4dab-9412-a4922cd85be1-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "cinder-f7529d8f-470f-4dab-9412-a4922cd85be1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-quobyte-f7529d8f-470f-4dab-9412-a4922cd85be1" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-f7529d8f-470f-4dab-9412-a4922cd85be1" acquired by "delete_volume" :: waited 0.014s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c751a3f2-9540-44c5-abdc-b2e4b1f89a3f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:21 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1
Sep 25 11:57:21 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:22 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1" returned: 0 in 0.419s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:22 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1
Sep 25 11:57:22 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:22 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f7529d8f-470f-4dab-9412-a4922cd85be1" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-f7529d8f-470f-4dab-9412-a4922cd85be1" released by "delete_volume" :: held 0.759s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Created reservations ['3c1a13d3-6b76-4d42-bff8-b20ddedd080f', '5469571d-bedd-443a-a5be-a09b5d02e787', 'c8fd1f58-643b-484f-8a75-c58021b997d2', '1cf04fba-dfa2-4acc-bb58-b0c6d550cd14'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:22 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:22 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:22 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.280s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Deleted volume successfully.
Sep 25 11:57:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2d6f765a-5c0e-405d-8580-932789050151 tempest-ProjectReaderTests-50674499 None] Lock "cinder-f7529d8f-470f-4dab-9412-a4922cd85be1-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (3d458545-bc6b-4659-bbee-282ca442b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf6f323-e006-4481-ae56-e1e14d99a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf6f323-e006-4481-ae56-e1e14d99a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408992216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e8bd77-12a9-47ce-a888-afbd27bfddd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:23Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e26bfd2-ec04-478d-a4f4-ac447a0c17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e26bfd2-ec04-478d-a4f4-ac447a0c17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad53ae0-dded-4585-8ced-6bd76020c8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad53ae0-dded-4585-8ced-6bd76020c8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e8bd77-12a9-47ce-a888-afbd27bfddd3', 'volume_name': 'volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa93dde-00da-4d61-866c-9eeccffff778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa93dde-00da-4d61-866c-9eeccffff778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dfb7be-9df0-4b54-b3d4-9dd22e6f11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Volume 03e8bd77-12a9-47ce-a888-afbd27bfddd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3', 'volume_size': 1}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408992216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e8bd77-12a9-47ce-a888-afbd27bfddd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:23Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Creating volume 03e8bd77-12a9-47ce-a888-afbd27bfddd3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:23 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:23 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 1073741824
Sep 25 11:57:23 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:24 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 1073741824" returned: 0 in 0.480s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:24 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3
Sep 25 11:57:24 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:24 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3" returned: 0 in 0.257s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dfb7be-9df0-4b54-b3d4-9dd22e6f11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863b5245-6162-47b6-ae08-f3f288f7dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Volume volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 (03e8bd77-12a9-47ce-a888-afbd27bfddd3): created successfully
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863b5245-6162-47b6-ae08-f3f288f7dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (3d458545-bc6b-4659-bbee-282ca442b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ebd17eb6-53a2-4960-b1f0-2851c88c5233 tempest-ProjectReaderTests-50674499 None] Created volume successfully.
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-03e8bd77-12a9-47ce-a888-afbd27bfddd3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "cinder-03e8bd77-12a9-47ce-a888-afbd27bfddd3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-quobyte-03e8bd77-12a9-47ce-a888-afbd27bfddd3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-03e8bd77-12a9-47ce-a888-afbd27bfddd3" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d09021d-becc-4efd-b9ff-c43ca094bed2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:24 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3
Sep 25 11:57:24 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:24 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3" returned: 0 in 0.367s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:25 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3
Sep 25 11:57:25 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:25 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-03e8bd77-12a9-47ce-a888-afbd27bfddd3" returned: 0 in 0.256s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-03e8bd77-12a9-47ce-a888-afbd27bfddd3" released by "delete_volume" :: held 0.665s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Created reservations ['ab21a781-16f7-45be-ab00-4b4ba8a5a7ae', 'e2ae264c-b8cd-4318-8290-5b8669be36ce', '69b4bd61-9c86-4ea7-88da-cb3066355bfd', '5aaf8eb8-7371-41d5-9ae5-6d43abd597b8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:25 devstack sudo[107639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:25 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:25 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:25 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Deleted volume successfully.
Sep 25 11:57:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-524e074b-15ef-47ec-b536-3208af3cedd4 tempest-ProjectReaderTests-50674499 None] Lock "cinder-03e8bd77-12a9-47ce-a888-afbd27bfddd3-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (5b083419-3740-4495-b3ae-d6444f7f9b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b09d76-5494-4636-8a09-16bf2b332a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b09d76-5494-4636-8a09-16bf2b332a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206375749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc784605-3916-41b6-a0c9-0c80574d662d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:26Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2408ac52-601c-4b7d-a7e8-a3034785ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2408ac52-601c-4b7d-a7e8-a3034785ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3076f6e8-26fc-4807-9627-d0b07e3033d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3076f6e8-26fc-4807-9627-d0b07e3033d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc784605-3916-41b6-a0c9-0c80574d662d', 'volume_name': 'volume-cc784605-3916-41b6-a0c9-0c80574d662d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a067f3a-4b20-4d0a-83df-393f0ce24cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a067f3a-4b20-4d0a-83df-393f0ce24cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b460cf6-77e2-4ec8-8c5c-93fc14f5d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Volume cc784605-3916-41b6-a0c9-0c80574d662d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc784605-3916-41b6-a0c9-0c80574d662d', 'volume_size': 1}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206375749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc784605-3916-41b6-a0c9-0c80574d662d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:26Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Creating volume cc784605-3916-41b6-a0c9-0c80574d662d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:26 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:26 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d 1073741824
Sep 25 11:57:26 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:26 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d 1073741824" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:26 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d
Sep 25 11:57:26 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:27 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d" returned: 0 in 0.284s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b460cf6-77e2-4ec8-8c5c-93fc14f5d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc784605-3916-41b6-a0c9-0c80574d662d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1b22ac-0d49-42e6-b549-6b45c8602ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Volume volume-cc784605-3916-41b6-a0c9-0c80574d662d (cc784605-3916-41b6-a0c9-0c80574d662d): created successfully
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1b22ac-0d49-42e6-b549-6b45c8602ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (5b083419-3740-4495-b3ae-d6444f7f9b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e9d81908-982e-4fea-b8e8-25dfea19c33e tempest-ProjectReaderTests-50674499 None] Created volume successfully.
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-cc784605-3916-41b6-a0c9-0c80574d662d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "cinder-cc784605-3916-41b6-a0c9-0c80574d662d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-quobyte-cc784605-3916-41b6-a0c9-0c80574d662d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-cc784605-3916-41b6-a0c9-0c80574d662d" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[148516bb-22fa-4e96-b55f-d5857c581e82]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:28 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d
Sep 25 11:57:28 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:28 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d" returned: 0 in 0.381s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:28 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d
Sep 25 11:57:28 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:29 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc784605-3916-41b6-a0c9-0c80574d662d" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-cc784605-3916-41b6-a0c9-0c80574d662d" released by "delete_volume" :: held 0.694s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Created reservations ['7aac95d5-6dc3-4f69-9397-ff73ded61204', '858af8a1-375c-4352-bb10-5c0ec89fd5d4', '48283ede-4db9-418b-b2c1-f7d476aab41b', 'c3fc1e07-c1f0-46d3-98b9-85d6dfef2781'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:29 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:29 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:29 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Deleted volume successfully.
Sep 25 11:57:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8056077c-13ce-48b1-a2d2-f688b8c5dde5 tempest-ProjectReaderTests-50674499 None] Lock "cinder-cc784605-3916-41b6-a0c9-0c80574d662d-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (f33ea34d-f3ac-4d22-ae86-a09339493fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8134549c-de70-4b9b-ad6d-397c8f11a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8134549c-de70-4b9b-ad6d-397c8f11a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595340565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330d0296-5fcd-47e1-9726-8a54e227fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:30Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a1a7fa-4fe1-4272-8755-5a25ef8fc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a1a7fa-4fe1-4272-8755-5a25ef8fc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adef1c96-0c97-4c01-ad7c-bcf3da45bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adef1c96-0c97-4c01-ad7c-bcf3da45bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330d0296-5fcd-47e1-9726-8a54e227fd44', 'volume_name': 'volume-330d0296-5fcd-47e1-9726-8a54e227fd44', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9fa3b1-4ed2-4812-b0e4-f68548b17a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9fa3b1-4ed2-4812-b0e4-f68548b17a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26642a-1065-4404-9dc7-29c2bb0af976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Volume 330d0296-5fcd-47e1-9726-8a54e227fd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330d0296-5fcd-47e1-9726-8a54e227fd44', 'volume_size': 1}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595340565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330d0296-5fcd-47e1-9726-8a54e227fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68544a427e04af09b44cfbcea66f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:30Z,use_quota=True,user_id='f31236f5e6f042fd97accdb3e11ae3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Creating volume 330d0296-5fcd-47e1-9726-8a54e227fd44 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:30 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:30 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 1073741824
Sep 25 11:57:30 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:30 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 1073741824" returned: 0 in 0.461s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:30 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44
Sep 25 11:57:30 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:30 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44" returned: 0 in 0.270s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26642a-1065-4404-9dc7-29c2bb0af976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330d0296-5fcd-47e1-9726-8a54e227fd44', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697917fe-df36-4fd4-bf78-f74e67a7eab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:30 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Volume volume-330d0296-5fcd-47e1-9726-8a54e227fd44 (330d0296-5fcd-47e1-9726-8a54e227fd44): created successfully
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697917fe-df36-4fd4-bf78-f74e67a7eab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:30 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Flow 'volume_create_manager' (f33ea34d-f3ac-4d22-ae86-a09339493fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-887e9335-7e8b-4605-bc76-fc16f1e2654a tempest-ProjectReaderTests-50674499 None] Created volume successfully.
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-330d0296-5fcd-47e1-9726-8a54e227fd44-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "cinder-330d0296-5fcd-47e1-9726-8a54e227fd44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Acquiring lock "cinder-quobyte-330d0296-5fcd-47e1-9726-8a54e227fd44" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-330d0296-5fcd-47e1-9726-8a54e227fd44" acquired by "delete_volume" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987c6aa-4f35-42ea-ac8a-df9721f81326]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:31 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44
Sep 25 11:57:31 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:31 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44" returned: 0 in 0.436s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:31 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44
Sep 25 11:57:31 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:31 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-330d0296-5fcd-47e1-9726-8a54e227fd44" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "cinder-quobyte-330d0296-5fcd-47e1-9726-8a54e227fd44" released by "delete_volume" :: held 0.766s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Created reservations ['f7200b9c-1c16-4ddb-94d7-a8d3d606d95b', '692cc654-e3c9-4472-9c72-dc84e5e0b478', '8a956a49-b6d5-4d1c-88a7-78bf85591537', 'fc67caf3-35ca-457d-ab71-5770e54c64f6'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:32 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:32 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:32 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:32 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Deleted volume successfully.
Sep 25 11:57:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-06faa4a7-ed49-406e-aea2-c44479ac4df7 tempest-ProjectReaderTests-50674499 None] Lock "cinder-330d0296-5fcd-47e1-9726-8a54e227fd44-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:57:42 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=27,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:57:42 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=28,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:51 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:57:51 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:51 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.366s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:57:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Flow 'volume_create_manager' (fa9034e2-778c-45a3-aa67-75b6e84d44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605649d8-b165-4d53-9071-7f402125994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605649d8-b165-4d53-9071-7f402125994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904700154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0aaf29-8345-43dc-a04d-5a1f355438e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a200c403ff46f6a1c658330ca1277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:58Z,use_quota=True,user_id='0d5701e470dd4c73933b010a95387a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a48549-5098-4b3e-9534-5621ae1cfe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a48549-5098-4b3e-9534-5621ae1cfe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa72887-3e1d-4784-b90e-d96b5306747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa72887-3e1d-4784-b90e-d96b5306747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0aaf29-8345-43dc-a04d-5a1f355438e8', 'volume_name': 'volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900c80c0-00ba-4501-976c-505d83fb4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900c80c0-00ba-4501-976c-505d83fb4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd38fa-8f57-4426-a1d7-8b73c0a7b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Volume fc0aaf29-8345-43dc-a04d-5a1f355438e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8', 'volume_size': 1}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904700154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0aaf29-8345-43dc-a04d-5a1f355438e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a200c403ff46f6a1c658330ca1277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:58Z,use_quota=True,user_id='0d5701e470dd4c73933b010a95387a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Creating volume fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:57:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:57:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:58 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 1073741824
Sep 25 11:57:58 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:59 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 1073741824" returned: 0 in 0.482s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:57:59 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:57:59 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:57:59 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.279s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd38fa-8f57-4426-a1d7-8b73c0a7b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c3866c-7cdd-41bb-ab1e-cd852fffcac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:57:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Volume volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 (fc0aaf29-8345-43dc-a04d-5a1f355438e8): created successfully
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c3866c-7cdd-41bb-ab1e-cd852fffcac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:57:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Flow 'volume_create_manager' (fa9034e2-778c-45a3-aa67-75b6e84d44a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:57:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-74863211-5f8b-42d4-8fd0-de92d6605294 tempest-SnapshotDependencyTests-625030296 None] Created volume successfully.
Sep 25 11:58:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Creating offline snapshot 531a16d5-8821-46f0-b865-aab428214d33 of volume fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:58:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d632f-56fc-4977-9b16-91824cc2e41b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:01 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:58:01 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:01 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.417s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:01 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 1G
Sep 25 11:58:01 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:01 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 1G" returned: 0 in 0.429s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:01 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:01 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:02 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.330s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:02 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 is being set with open permissions: ugo+rw
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:02 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:02 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:02 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:02 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info
Sep 25 11:58:02 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:02 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info" returned: 0 in 0.273s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:02 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info is being set with open permissions: ugo+rw
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:02 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info
Sep 25 11:58:02 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:02 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.info" returned: 0 in 0.276s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ce9902ca-c50b-48a3-93c5-5cbf09377e28 tempest-SnapshotDependencyTests-625030296 None] Create snapshot completed successfully
Sep 25 11:58:04 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Flow 'volume_create_manager' (5ff680dc-7978-48dd-8c88-165e8b19010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f17982-e0bc-4123-90c8-d590fea977ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f17982-e0bc-4123-90c8-d590fea977ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e2ab18-bf06-41b8-b424-b9bb4685276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a200c403ff46f6a1c658330ca1277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=531a16d5-8821-46f0-b865-aab428214d33,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:05Z,use_quota=True,user_id='0d5701e470dd4c73933b010a95387a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:04 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa97797b-7f44-478c-a559-363c94156dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa97797b-7f44-478c-a559-363c94156dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6f0ed7-4e0e-4faa-8957-4da350577b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6f0ed7-4e0e-4faa-8957-4da350577b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51e2ab18-bf06-41b8-b424-b9bb4685276d', 'volume_name': 'volume-51e2ab18-bf06-41b8-b424-b9bb4685276d', 'volume_size': 1, 'snapshot_id': '531a16d5-8821-46f0-b865-aab428214d33'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2213a1-f68f-4645-bb4f-ff15568bd23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2213a1-f68f-4645-bb4f-ff15568bd23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb5d3b8-abc0-4a4b-8ab4-ed8bdc3e4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Volume 51e2ab18-bf06-41b8-b424-b9bb4685276d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51e2ab18-bf06-41b8-b424-b9bb4685276d', 'volume_size': 1, 'snapshot_id': '531a16d5-8821-46f0-b865-aab428214d33'}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33-51e2ab18-bf06-41b8-b424-b9bb4685276d" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33-51e2ab18-bf06-41b8-b424-b9bb4685276d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Creating volume 51e2ab18-bf06-41b8-b424-b9bb4685276d from snapshot 531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] snapshot: 531a16d5-8821-46f0-b865-aab428214d33, volume: 51e2ab18-bf06-41b8-b424-b9bb4685276d,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a12035-1e0c-4d4f-9cc2-e35c8ca001ef]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:05 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:05 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:05 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.438s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999446e-2cde-40e3-b327-b6b0816c157d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:05 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:58:05 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:06 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.446s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:58:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:58:06 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:58:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:06 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d
Sep 25 11:58:06 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:12 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d" returned: 0 in 6.281s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:58:12 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Converted 1024.00 MB image at 163.01 MB/s
Sep 25 11:58:12 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d is being set with open permissions: ugo+rw
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:12 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d
Sep 25 11:58:12 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:12 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d" returned: 0 in 0.252s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" released by "_copy_volume_from_snapshot" :: held 7.514s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33-51e2ab18-bf06-41b8-b424-b9bb4685276d" released by "_create_volume_from_snapshot" :: held 7.582s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.600s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb5d3b8-abc0-4a4b-8ab4-ed8bdc3e4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e2ab18-bf06-41b8-b424-b9bb4685276d', 'volume_size': 1, 'snapshot_id': '531a16d5-8821-46f0-b865-aab428214d33'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952e5c81-f780-4dfd-9d83-a05c6c6f5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Volume volume-51e2ab18-bf06-41b8-b424-b9bb4685276d (51e2ab18-bf06-41b8-b424-b9bb4685276d): created successfully
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952e5c81-f780-4dfd-9d83-a05c6c6f5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Flow 'volume_create_manager' (5ff680dc-7978-48dd-8c88-165e8b19010b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-79850146-3659-4b57-854b-f55ae6e799f3 tempest-SnapshotDependencyTests-625030296 None] Created volume successfully.
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-531a16d5-8821-46f0-b865-aab428214d33-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-531a16d5-8821-46f0-b865-aab428214d33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Deleting offline snapshot 531a16d5-8821-46f0-b865-aab428214d33 of volume fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] snapshot_file for this snap is: volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[42691614-88a9-4379-93f6-26e7bf5f5fe1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:13 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:13 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:14 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.415s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86dd04-21d3-419b-be25-7f45a919b364]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:14 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:58:14 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:14 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.539s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:14 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:14 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:15 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.351s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:15 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33
Sep 25 11:58:15 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:15 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8.531a16d5-8821-46f0-b865-aab428214d33" returned: 0 in 0.268s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-531a16d5-8821-46f0-b865-aab428214d33" released by "_delete_snapshot" :: held 1.687s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" released by "delete_snapshot" :: held 1.711s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Created reservations ['fbc19f57-e536-4a3f-88d8-76c2d225a15b', 'ca3e2d01-975c-4d74-a132-33ccf7fe13cc', '97c6bcc6-3bd5-461d-a6e8-fc648caa7b18', '5292b259-d19a-469c-8850-5df02458eaf7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:15 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Delete snapshot completed successfully.
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f7c93c77-d706-494a-b443-8af702023c53 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-531a16d5-8821-46f0-b865-aab428214d33-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-fc0aaf29-8345-43dc-a04d-5a1f355438e8-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-fc0aaf29-8345-43dc-a04d-5a1f355438e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[65975fc8-33bb-412e-8f84-bed8087efc7b]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:16 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:58:16 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:16 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.442s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:16 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8
Sep 25 11:58:16 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:16 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-fc0aaf29-8345-43dc-a04d-5a1f355438e8" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-fc0aaf29-8345-43dc-a04d-5a1f355438e8" released by "delete_volume" :: held 0.797s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Created reservations ['7181011c-4b99-4072-8261-493d70c12b99', 'd01bd9a8-4fbc-4f69-a938-16888ac04668', '7c01018b-704d-4be9-9f35-31b702ebc880', '3051fa09-1c04-4fbb-82df-aafff5ba06f6'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:16 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:16 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-51e2ab18-bf06-41b8-b424-b9bb4685276d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-51e2ab18-bf06-41b8-b424-b9bb4685276d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb93d7-2184-4928-966e-90e82e1863e4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:17 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.315s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:17 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Deleted volume successfully.
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e08856df-cb8a-4141-8d9c-9998725e1157 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-fc0aaf29-8345-43dc-a04d-5a1f355438e8-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:17 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d
Sep 25 11:58:17 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:17 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d" returned: 0 in 0.429s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:17 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d
Sep 25 11:58:17 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:17 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-51e2ab18-bf06-41b8-b424-b9bb4685276d" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-quobyte-51e2ab18-bf06-41b8-b424-b9bb4685276d" released by "delete_volume" :: held 0.753s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:17 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Created reservations ['ae32718b-1c78-4d62-9623-47a03211d2a2', 'b372980c-109b-4e83-ace9-978f76e5d3df', '8467bd89-bd7f-47b1-83aa-eb174d94966b', 'dc4b5f33-1291-4fb2-b6ba-c85d11f8c0ff'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:18 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:18 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:18 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Deleted volume successfully.
Sep 25 11:58:18 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6009985f-ba96-47eb-b73d-ed61a51b2fb1 tempest-SnapshotDependencyTests-625030296 None] Lock "cinder-51e2ab18-bf06-41b8-b424-b9bb4685276d-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:28 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:58:28 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (f6a58ebc-02a3-41a9-8ab9-39e87659acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef869aaa-ce66-401b-8ab5-045c3170c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef869aaa-ce66-401b-8ab5-045c3170c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460584125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01602e3f-eaa9-482c-b8a5-d744e22fa2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:45Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc37798-d5eb-4991-9b9b-f4e2b4fb78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc37798-d5eb-4991-9b9b-f4e2b4fb78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a84ac-e051-41f4-bfa3-1c348ad188d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a84ac-e051-41f4-bfa3-1c348ad188d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01602e3f-eaa9-482c-b8a5-d744e22fa2c6', 'volume_name': 'volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4be044-5998-4469-8905-82a6a471c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4be044-5998-4469-8905-82a6a471c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9c627c-643d-46c1-82ff-b78375c7fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:44 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume 01602e3f-eaa9-482c-b8a5-d744e22fa2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6', 'volume_size': 1}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460584125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01602e3f-eaa9-482c-b8a5-d744e22fa2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:45Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume 01602e3f-eaa9-482c-b8a5-d744e22fa2c6 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:44 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:44 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 1073741824
Sep 25 11:58:44 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (1dbccc95-c234-44b1-b11d-86ff47fb7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb05ff9-03bd-4769-8804-910ed1036586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb05ff9-03bd-4769-8804-910ed1036586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985845357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37312b15-e092-467b-b3d3-322a530ae4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:45Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37237029-6536-4209-bcbc-a5a5e847931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37237029-6536-4209-bcbc-a5a5e847931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:45 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448f8b7b-f4e7-4ab8-bdf8-79b548ce7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448f8b7b-f4e7-4ab8-bdf8-79b548ce7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37312b15-e092-467b-b3d3-322a530ae4c4', 'volume_name': 'volume-37312b15-e092-467b-b3d3-322a530ae4c4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbfd10d-a20f-445e-a014-6d3d09543cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbfd10d-a20f-445e-a014-6d3d09543cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb835311-bbc4-441c-9af0-d747b9d104f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:45 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Volume 37312b15-e092-467b-b3d3-322a530ae4c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37312b15-e092-467b-b3d3-322a530ae4c4', 'volume_size': 1}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 1073741824" returned: 0 in 0.879s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:45 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6
Sep 25 11:58:45 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (b74a4d54-a94d-40a7-b37e-bfebeebdbd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fdb205-0418-4ec3-9f91-367647dc44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fdb205-0418-4ec3-9f91-367647dc44e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1539734664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6648e80-602d-4707-bd07-14f2ea8286e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:46Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f45f1f-6d8b-4cb5-b6a5-b47653ec8d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f45f1f-6d8b-4cb5-b6a5-b47653ec8d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affa85fc-b438-4bf8-b6d5-d7a24024130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affa85fc-b438-4bf8-b6d5-d7a24024130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6648e80-602d-4707-bd07-14f2ea8286e8', 'volume_name': 'volume-f6648e80-602d-4707-bd07-14f2ea8286e8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf415b5b-5608-4018-b812-98d94b332c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf415b5b-5608-4018-b812-98d94b332c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230f7062-f4f1-4e93-bce6-a6d9aad12dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Volume f6648e80-602d-4707-bd07-14f2ea8286e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6648e80-602d-4707-bd07-14f2ea8286e8', 'volume_size': 1}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" returned: 0 in 0.599s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985845357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37312b15-e092-467b-b3d3-322a530ae4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:45Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Creating volume 37312b15-e092-467b-b3d3-322a530ae4c4 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:46 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:46 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 1073741824
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9c627c-643d-46c1-82ff-b78375c7fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5716c6-6826-4938-a3b3-62121873ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:46 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 (01602e3f-eaa9-482c-b8a5-d744e22fa2c6): created successfully
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5716c6-6826-4938-a3b3-62121873ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (f6a58ebc-02a3-41a9-8ab9-39e87659acd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:46 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-87e429c9-8bf2-4679-bc07-f5dfc59ef893 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:46 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (b5947758-0582-4211-a02f-afdb1e4b9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91214f29-6566-4d01-a039-e353d7ab6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91214f29-6566-4d01-a039-e353d7ab6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1321085630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2826624-dadb-4216-ac46-6683ef02712d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:47Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62305f29-2de7-495a-8128-331e540494ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62305f29-2de7-495a-8128-331e540494ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235a988c-03fc-4dbb-b5bc-5a3f21d25be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235a988c-03fc-4dbb-b5bc-5a3f21d25be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2826624-dadb-4216-ac46-6683ef02712d', 'volume_name': 'volume-a2826624-dadb-4216-ac46-6683ef02712d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9499154e-846c-4de6-9799-fdadc473aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9499154e-846c-4de6-9799-fdadc473aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22063764-4c8d-4ace-b9cf-3023fa537e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Volume a2826624-dadb-4216-ac46-6683ef02712d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2826624-dadb-4216-ac46-6683ef02712d', 'volume_size': 1}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:47 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 1073741824" returned: 0 in 0.851s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:47 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4
Sep 25 11:58:47 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (5274ba7f-5547-4cd6-88a7-a83e7d733665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dfa56f-56f6-4d66-b958-2fe6e2176a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dfa56f-56f6-4d66-b958-2fe6e2176a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3951376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2dd94e-dff2-44b6-8b52-3c610961f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5051d4-7322-40a0-be9d-8988786c6667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5051d4-7322-40a0-be9d-8988786c6667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226729ec-5e03-471e-b27d-6cd5adeda963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226729ec-5e03-471e-b27d-6cd5adeda963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2dd94e-dff2-44b6-8b52-3c610961f672', 'volume_name': 'volume-9b2dd94e-dff2-44b6-8b52-3c610961f672', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975c787c-23d3-4fbb-a84b-68b18bfed6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975c787c-23d3-4fbb-a84b-68b18bfed6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46e4996-e1f9-431e-85b9-c6ef0d68da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Volume 9b2dd94e-dff2-44b6-8b52-3c610961f672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2dd94e-dff2-44b6-8b52-3c610961f672', 'volume_size': 1}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4" returned: 0 in 0.668s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1539734664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6648e80-602d-4707-bd07-14f2ea8286e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:46Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Creating volume f6648e80-602d-4707-bd07-14f2ea8286e8 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:47 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:48 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 1073741824
Sep 25 11:58:48 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb835311-bbc4-441c-9af0-d747b9d104f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37312b15-e092-467b-b3d3-322a530ae4c4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462dd266-6616-4249-ba29-bba2ef654662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Volume volume-37312b15-e092-467b-b3d3-322a530ae4c4 (37312b15-e092-467b-b3d3-322a530ae4c4): created successfully
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462dd266-6616-4249-ba29-bba2ef654662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (1dbccc95-c234-44b1-b11d-86ff47fb7590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (d14f7460-4220-4c35-a943-5086ced51a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a05e078-8d84-48f5-98ab-a72a84cf9589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-98ada85e-f606-4473-909f-b6f025fdac95 tempest-CreateVolumesFromImageTest-1631539350 None] Created volume successfully.
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a05e078-8d84-48f5-98ab-a72a84cf9589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810250149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f389939-dbc3-4edb-b4d1-4660ea68ff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac81376-c94e-4693-91c7-6facf0f718eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac81376-c94e-4693-91c7-6facf0f718eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac4dc65-7010-4073-b0a5-61a3ffa69e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac4dc65-7010-4073-b0a5-61a3ffa69e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f389939-dbc3-4edb-b4d1-4660ea68ff9d', 'volume_name': 'volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d071060-b032-41db-b849-bb186d89dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d071060-b032-41db-b849-bb186d89dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553b8c86-f32e-4601-afcb-ba08b979515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume 9f389939-dbc3-4edb-b4d1-4660ea68ff9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d', 'volume_size': 1}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (dc3a4591-f5e9-4b2a-991b-a40aa44f3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f531111-6844-43f2-9d4d-979fb27dcc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f531111-6844-43f2-9d4d-979fb27dcc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1696583465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87163ee-2414-4b3a-b40f-0ccc4f4a57db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1bcdc-2a64-492e-a5f4-4eceedb768b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1bcdc-2a64-492e-a5f4-4eceedb768b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3abe5a-24fe-40bc-9c68-8546602b6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3abe5a-24fe-40bc-9c68-8546602b6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87163ee-2414-4b3a-b40f-0ccc4f4a57db', 'volume_name': 'volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca2fbd6-fbeb-4a2b-91aa-bd577c631133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca2fbd6-fbeb-4a2b-91aa-bd577c631133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff88946-351f-4d31-9e84-4029b2c25ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Volume f87163ee-2414-4b3a-b40f-0ccc4f4a57db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db', 'volume_size': 1}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:48 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (4afaadfe-79d6-4332-ac37-ddb1e28e90da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d36422-e908-4117-9965-15486f965d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 1073741824" returned: 0 in 0.980s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d36422-e908-4117-9965-15486f965d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46138029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd26c79-6b4d-4426-b373-ee74c2aea77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:49Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f5518d-c422-421c-808c-bcd2aa7ce021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f5518d-c422-421c-808c-bcd2aa7ce021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ef1f7c-2088-4f5d-a6c0-6c49f22ddba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ef1f7c-2088-4f5d-a6c0-6c49f22ddba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd26c79-6b4d-4426-b373-ee74c2aea77a', 'volume_name': 'volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d24f7d-9740-4338-94d8-4c67afee4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d24f7d-9740-4338-94d8-4c67afee4e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c22a1-7f01-470b-9f2d-95f94aad5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume dcd26c79-6b4d-4426-b373-ee74c2aea77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a', 'volume_size': 1}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:49 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8
Sep 25 11:58:49 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:49 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (f4d288f2-59c5-40fd-b5d4-4df21c050bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8639001-522d-4389-a255-6c535416159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8" returned: 0 in 0.545s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.488s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1321085630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2826624-dadb-4216-ac46-6683ef02712d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:47Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Creating volume a2826624-dadb-4216-ac46-6683ef02712d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:49 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:49 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d 1073741824
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8639001-522d-4389-a255-6c535416159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470198289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc54140b-9434-4a42-bb7d-dfc310150ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:49Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fce38b-266d-469c-b1c5-fc3445776bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fce38b-266d-469c-b1c5-fc3445776bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9f91-9dfb-46ad-9e07-a51f7f56b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9f91-9dfb-46ad-9e07-a51f7f56b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc54140b-9434-4a42-bb7d-dfc310150ca8', 'volume_name': 'volume-cc54140b-9434-4a42-bb7d-dfc310150ca8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40eeb74-f101-4117-974e-aad268721330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40eeb74-f101-4117-974e-aad268721330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baba1f74-07ac-4bb1-a9bd-24f9dc4b0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume cc54140b-9434-4a42-bb7d-dfc310150ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc54140b-9434-4a42-bb7d-dfc310150ca8', 'volume_size': 1}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230f7062-f4f1-4e93-bce6-a6d9aad12dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6648e80-602d-4707-bd07-14f2ea8286e8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac88e69-341d-4a02-81c8-9a090d986dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Volume volume-f6648e80-602d-4707-bd07-14f2ea8286e8 (f6648e80-602d-4707-bd07-14f2ea8286e8): created successfully
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac88e69-341d-4a02-81c8-9a090d986dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (b74a4d54-a94d-40a7-b37e-bfebeebdbd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9c828963-590a-4428-9673-647e032be9e9 tempest-CreateVolumesFromImageTest-1631539350 None] Created volume successfully.
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (9aa321bb-d1c9-471a-a219-d8e6dcbb52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b8e518-6592-4988-a545-6ecf5428a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b8e518-6592-4988-a545-6ecf5428a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467784037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb182f8e-e4bd-4b3d-951e-573058a742e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:50Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1269735f-7662-4743-82e8-f22eccd33f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1269735f-7662-4743-82e8-f22eccd33f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9407186a-82fd-4c88-83a5-9e7a28f69467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9407186a-82fd-4c88-83a5-9e7a28f69467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb182f8e-e4bd-4b3d-951e-573058a742e9', 'volume_name': 'volume-cb182f8e-e4bd-4b3d-951e-573058a742e9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9489e-866f-42ea-8946-6658a0417f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9489e-866f-42ea-8946-6658a0417f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019a20c3-3120-45e3-a724-6c55abeb156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume cb182f8e-e4bd-4b3d-951e-573058a742e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb182f8e-e4bd-4b3d-951e-573058a742e9', 'volume_size': 1}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d 1073741824" returned: 0 in 0.771s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:50 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d
Sep 25 11:58:50 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:50 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d" returned: 0 in 0.395s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.922s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3951376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2dd94e-dff2-44b6-8b52-3c610961f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Creating volume 9b2dd94e-dff2-44b6-8b52-3c610961f672 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:50 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:50 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 1073741824
Sep 25 11:58:50 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22063764-4c8d-4ace-b9cf-3023fa537e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2826624-dadb-4216-ac46-6683ef02712d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4932e46-622c-45f4-bb3e-50ddf6ac0ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:50 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Volume volume-a2826624-dadb-4216-ac46-6683ef02712d (a2826624-dadb-4216-ac46-6683ef02712d): created successfully
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4932e46-622c-45f4-bb3e-50ddf6ac0ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (b5947758-0582-4211-a02f-afdb1e4b9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-072c3b19-ed98-4b72-a479-e52881a2c68b tempest-CreateVolumesFromImageTest-1631539350 None] Created volume successfully.
Sep 25 11:58:50 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (0268b843-52ac-4b3e-bb34-d33d4769bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a47841-24db-4f23-9ee5-e5e70e9bdd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a47841-24db-4f23-9ee5-e5e70e9bdd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146760838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dafe79c-8cda-4da8-839b-6f1e40e1c2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:51Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31398d4d-75c4-44d7-844d-0e2783f3c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31398d4d-75c4-44d7-844d-0e2783f3c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47f601-7d20-46b3-9c1f-b5ae60293ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47f601-7d20-46b3-9c1f-b5ae60293ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dafe79c-8cda-4da8-839b-6f1e40e1c2da', 'volume_name': 'volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a41ff-73bf-413a-84bc-ba5ee734554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a41ff-73bf-413a-84bc-ba5ee734554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3780efab-533c-4304-85b1-243acf30d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume 0dafe79c-8cda-4da8-839b-6f1e40e1c2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da', 'volume_size': 1}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:51 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 1073741824" returned: 0 in 0.632s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:51 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:51 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:51 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672
Sep 25 11:58:51 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:51 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:58:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:58:52 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672" returned: 0 in 0.483s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.585s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810250149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f389939-dbc3-4edb-b4d1-4660ea68ff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume 9f389939-dbc3-4edb-b4d1-4660ea68ff9d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:52 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:52 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d 1073741824
Sep 25 11:58:52 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46e4996-e1f9-431e-85b9-c6ef0d68da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2dd94e-dff2-44b6-8b52-3c610961f672', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a5cd03-1be1-4e26-9399-56a585912db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Flow 'volume_create_manager' (467615aa-26a5-4793-8234-328b7e1f8b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26dedd3-90ad-4c95-af5c-cbe376a9a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Volume volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 (9b2dd94e-dff2-44b6-8b52-3c610961f672): created successfully
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a5cd03-1be1-4e26-9399-56a585912db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (5274ba7f-5547-4cd6-88a7-a83e7d733665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26dedd3-90ad-4c95-af5c-cbe376a9a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f75c6d4-dd65-4571-81de-2fe397f3251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4599ad23adaa4384b765c8215405bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:52Z,use_quota=True,user_id='d6b3c680b48144708794a33b6f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4bea6bd-41c0-4e94-9e81-d0f7b70373e4),volume_type_id=d4bea6bd-41c0-4e94-9e81-d0f7b70373e4)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147e2010-05f5-4b72-a03e-fa487caa0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147e2010-05f5-4b72-a03e-fa487caa0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d5356f-d412-4e15-a224-d726018d6ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:58:52 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b806ad76-0693-4869-bbe7-941a2075c248 tempest-CreateVolumesFromImageTest-1631539350 None] Created volume successfully.
Sep 25 11:58:52 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d 1073741824" returned: 0 in 0.608s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d5356f-d412-4e15-a224-d726018d6ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f75c6d4-dd65-4571-81de-2fe397f3251a', 'volume_name': 'volume-4f75c6d4-dd65-4571-81de-2fe397f3251a', 'volume_size': 1, 'image_id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03845e42c99314611d953162b300b981', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4599ad23adaa4384b765c8215405bb5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f91eb85daa23f25fb893d5d95d65bbbd02ced1804c9878a9b5af327823e2d9156dd17f3db47c926d4f917fb6c7fe26e7158f32d32487f627760f82b39a6482d5', 'id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'created_at': datetime.datetime(2026, 9, 25, 9, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de80ad1b-32c6-4513-9751-88499af46eb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63de930>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4135a-d5c1-40f5-abed-089585aa8644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4135a-d5c1-40f5-abed-089585aa8644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6236ff7f-942f-470e-94b2-45e1207ac14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:52 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Volume 4f75c6d4-dd65-4571-81de-2fe397f3251a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f75c6d4-dd65-4571-81de-2fe397f3251a', 'volume_size': 1, 'image_id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03845e42c99314611d953162b300b981', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4599ad23adaa4384b765c8215405bb5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f91eb85daa23f25fb893d5d95d65bbbd02ced1804c9878a9b5af327823e2d9156dd17f3db47c926d4f917fb6c7fe26e7158f32d32487f627760f82b39a6482d5', 'id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'created_at': datetime.datetime(2026, 9, 25, 9, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de80ad1b-32c6-4513-9751-88499af46eb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63de930>}
Sep 25 11:58:52 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Trying to clone 4f75c6d4-dd65-4571-81de-2fe397f3251a from image de80ad1b-32c6-4513-9751-88499af46eb5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:58:52 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:52 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:58:52 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3777b6-1034-4883-b357-71489b73f3b9]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:53 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" returned: 0 in 0.405s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.474s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1696583465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87163ee-2414-4b3a-b40f-0ccc4f4a57db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75fe6e2d9794858881e65254143245d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:48Z,use_quota=True,user_id='9b08980f4ccf4223978998e8f12a4260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Creating volume f87163ee-2414-4b3a-b40f-0ccc4f4a57db {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:53 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553b8c86-f32e-4601-afcb-ba08b979515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa860f2-e63a-4cad-bb8e-91af6057f0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:53 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db 1073741824
Sep 25 11:58:53 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:53 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d (9f389939-dbc3-4edb-b4d1-4660ea68ff9d): created successfully
Sep 25 11:58:53 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:58:53 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa860f2-e63a-4cad-bb8e-91af6057f0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (d14f7460-4220-4c35-a943-5086ced51a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c29ff8e6-aaf3-453e-a898-48f35bd60815 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:53 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:53 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:58:53 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:53 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db 1073741824" returned: 0 in 0.722s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:53 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db
Sep 25 11:58:53 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:58:54 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (93bca0ee-79c4-4b2c-8e2f-8da71e5ff7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55850faa-6b40-4a6e-85df-3217afc31c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Temporary image de80ad1b-32c6-4513-9751-88499af46eb5 is fetched for user d6b3c680b48144708794a33b6f8bb460. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55850faa-6b40-4a6e-85df-3217afc31c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650360134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365983a6-6959-46ef-80df-19f49ed15c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:54Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f085197f-989f-4900-b136-35346f357567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f085197f-989f-4900-b136-35346f357567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08768f2e-698a-44a7-867e-76a87fd0b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08768f2e-698a-44a7-867e-76a87fd0b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365983a6-6959-46ef-80df-19f49ed15c41', 'volume_name': 'volume-365983a6-6959-46ef-80df-19f49ed15c41', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e452cb-a629-463b-8df0-e1a439342ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e452cb-a629-463b-8df0-e1a439342ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb278af4-2607-4ac6-ae1f-92ad18dea46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Volume 365983a6-6959-46ef-80df-19f49ed15c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365983a6-6959-46ef-80df-19f49ed15c41', 'volume_size': 1}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:54 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ffdbc-d448-43ea-a60a-2cd0bf73b7ea]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.262s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46138029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd26c79-6b4d-4426-b373-ee74c2aea77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:49Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume dcd26c79-6b4d-4426-b373-ee74c2aea77a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:54 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff88946-351f-4d31-9e84-4029b2c25ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73e2db4-f003-420a-a1ed-3f3ecc1bea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:54 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a 1073741824
Sep 25 11:58:54 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:54 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Volume volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db (f87163ee-2414-4b3a-b40f-0ccc4f4a57db): created successfully
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73e2db4-f003-420a-a1ed-3f3ecc1bea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Flow 'volume_create_manager' (dc3a4591-f5e9-4b2a-991b-a40aa44f3c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:54 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-55bf33e3-cfdb-4be6-aed8-1683a67d3684 tempest-CreateVolumesFromImageTest-1631539350 None] Created volume successfully.
Sep 25 11:58:54 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:58:54 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:54 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:54 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:58:54 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:54 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a 1073741824" returned: 0 in 0.510s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:54 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a
Sep 25 11:58:54 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:55 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:55 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a" returned: 0 in 0.283s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.359s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470198289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc54140b-9434-4a42-bb7d-dfc310150ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:49Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume cc54140b-9434-4a42-bb7d-dfc310150ca8 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:55 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c22a1-7f01-470b-9f2d-95f94aad5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:55 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 1073741824
Sep 25 11:58:55 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d3f1f1-330e-4739-8c52-71c0b68bb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a (dcd26c79-6b4d-4426-b373-ee74c2aea77a): created successfully
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d3f1f1-330e-4739-8c52-71c0b68bb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (4afaadfe-79d6-4332-ac37-ddb1e28e90da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ad1ee5b4-63b8-46a0-be99-d4bc731f7b39 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-f87163ee-2414-4b3a-b40f-0ccc4f4a57db-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-f87163ee-2414-4b3a-b40f-0ccc4f4a57db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-quobyte-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[78820f4f-cedf-4372-87c9-0711c20039d6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:55 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db
Sep 25 11:58:55 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:55 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 1073741824" returned: 0 in 0.563s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:55 devstack sudo[108029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8
Sep 25 11:58:55 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:55 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" returned: 0 in 0.414s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:56 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db
Sep 25 11:58:56 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:56 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8" returned: 0 in 0.284s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.645s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467784037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb182f8e-e4bd-4b3d-951e-573058a742e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:50Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume cb182f8e-e4bd-4b3d-951e-573058a742e9 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:56 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baba1f74-07ac-4bb1-a9bd-24f9dc4b0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc54140b-9434-4a42-bb7d-dfc310150ca8', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5589d4c-2b8a-4eec-b674-ff2b1ac3db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:56 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 1073741824
Sep 25 11:58:56 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 (cc54140b-9434-4a42-bb7d-dfc310150ca8): created successfully
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5589d4c-2b8a-4eec-b674-ff2b1ac3db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (f4d288f2-59c5-40fd-b5d4-4df21c050bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-610266b8-0f39-442c-bed5-151b5ab0f583 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:56 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" returned: 0 in 0.280s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-f87163ee-2414-4b3a-b40f-0ccc4f4a57db" released by "delete_volume" :: held 0.745s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Created reservations ['3f0b4961-fc98-4c0d-b729-ecbae5543f6d', 'a582bb81-bd52-469e-bc80-b1ae2d9fa694', '9d160ab3-c84d-42c9-9e1b-fb1dc00edb53', 'fe49bcd8-280d-450e-91a0-1b459a804154'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:56 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:56 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:56 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 1073741824" returned: 0 in 0.601s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-9b2dd94e-dff2-44b6-8b52-3c610961f672-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-9b2dd94e-dff2-44b6-8b52-3c610961f672-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:56 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9
Sep 25 11:58:56 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-quobyte-9b2dd94e-dff2-44b6-8b52-3c610961f672" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:56 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.343s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Deleted volume successfully.
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-9b2dd94e-dff2-44b6-8b52-3c610961f672" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e1fe140e-fe5c-401b-a55b-fdcfc04141d1 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-f87163ee-2414-4b3a-b40f-0ccc4f4a57db-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d26d40-9be1-4ba1-9a85-935b74e5cbb2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:56 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672
Sep 25 11:58:56 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:57 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9" returned: 0 in 0.322s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.951s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146760838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dafe79c-8cda-4da8-839b-6f1e40e1c2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd19a9bfbf48f4ae14d939a76845f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:51Z,use_quota=True,user_id='20f0462fa46047b1bc1694ca6bc3bcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Creating volume 0dafe79c-8cda-4da8-839b-6f1e40e1c2da {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:57 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019a20c3-3120-45e3-a724-6c55abeb156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb182f8e-e4bd-4b3d-951e-573058a742e9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ddf09-ce95-4cbe-9a12-123bc19aabf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:57 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da 1073741824
Sep 25 11:58:57 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:57 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 (cb182f8e-e4bd-4b3d-951e-573058a742e9): created successfully
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ddf09-ce95-4cbe-9a12-123bc19aabf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (9aa321bb-d1c9-471a-a219-d8e6dcbb52a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:57 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8f9b8d69-c7ab-44e9-af21-4337922dc5b2 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:57 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672" returned: 0 in 0.475s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:57 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672
Sep 25 11:58:57 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:57 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da 1073741824" returned: 0 in 0.524s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:57 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9b2dd94e-dff2-44b6-8b52-3c610961f672" returned: 0 in 0.312s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:57 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da
Sep 25 11:58:57 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-9b2dd94e-dff2-44b6-8b52-3c610961f672" released by "delete_volume" :: held 0.861s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Created reservations ['7e740d28-8b36-4823-bf70-7c74a5743035', 'cc9a3c33-f5ed-4bb4-b401-e82209c56d9d', 'bd88880f-fa34-4378-bd8b-375830345aa2', '7d4d1aa3-56e3-4b66-9ba9-6a371926d5b8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:57 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:57 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-a2826624-dadb-4216-ac46-6683ef02712d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-a2826624-dadb-4216-ac46-6683ef02712d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:57 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-quobyte-a2826624-dadb-4216-ac46-6683ef02712d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" returned: 0 in 0.347s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.803s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650360134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365983a6-6959-46ef-80df-19f49ed15c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:54Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Creating volume 365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:57 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3780efab-533c-4304-85b1-243acf30d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac685ba-1758-4bff-9e1a-ebc825153b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:58 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 1073741824
Sep 25 11:58:58 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-a2826624-dadb-4216-ac46-6683ef02712d" acquired by "delete_volume" :: waited 0.065s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Volume volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da (0dafe79c-8cda-4da8-839b-6f1e40e1c2da): created successfully
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac685ba-1758-4bff-9e1a-ebc825153b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Flow 'volume_create_manager' (0268b843-52ac-4b3e-bb34-d33d4769bac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bc9a8-d7cf-4669-9d7c-f78ffc31c43e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-73fb7ded-c811-4824-80f8-b9833fe2b349 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created volume successfully.
Sep 25 11:58:58 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Deleted volume successfully.
Sep 25 11:58:58 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d
Sep 25 11:58:58 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-2a3a8482-49ef-4a66-9b19-07b8f85543c9 tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-9b2dd94e-dff2-44b6-8b52-3c610961f672-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:58 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:58 devstack sudo[108082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d
Sep 25 11:58:58 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:58 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 1073741824" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:58 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41
Sep 25 11:58:58 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:58 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-a2826624-dadb-4216-ac46-6683ef02712d" returned: 0 in 0.317s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-a2826624-dadb-4216-ac46-6683ef02712d" released by "delete_volume" :: held 0.833s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:58 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41" returned: 0 in 0.287s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.895s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f75c6d4-dd65-4571-81de-2fe397f3251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4599ad23adaa4384b765c8215405bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:52Z,use_quota=True,user_id='d6b3c680b48144708794a33b6f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4bea6bd-41c0-4e94-9e81-d0f7b70373e4),volume_type_id=d4bea6bd-41c0-4e94-9e81-d0f7b70373e4)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Creating volume 4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:58:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-0dafe79c-8cda-4da8-839b-6f1e40e1c2da-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb278af4-2607-4ac6-ae1f-92ad18dea46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365983a6-6959-46ef-80df-19f49ed15c41', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:58 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1073741824
Sep 25 11:58:58 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2537d852-66ad-485d-9960-82d7cc46b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:58:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-0dafe79c-8cda-4da8-839b-6f1e40e1c2da-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Volume volume-365983a6-6959-46ef-80df-19f49ed15c41 (365983a6-6959-46ef-80df-19f49ed15c41): created successfully
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2537d852-66ad-485d-9960-82d7cc46b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (93bca0ee-79c4-4b2c-8e2f-8da71e5ff7b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:58:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0e2ba594-c227-497f-878e-e6d2bad3f94e tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Created reservations ['ce50241f-c781-4932-93ee-140d416b9fba', '908e69fd-2642-4a09-82dc-28e8c57b7129', '30a595a4-96f9-4e35-8619-e6b6c3239c3a', 'c3ee765d-ddf0-45d5-9379-5aff5731e53e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e3749-efde-434a-98a5-701265b542ee]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:59 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:58:59 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:59 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da
Sep 25 11:58:59 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:59 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1073741824" returned: 0 in 0.660s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:59 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:58:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Deleted volume successfully.
Sep 25 11:58:59 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a
Sep 25 11:58:59 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:59 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" returned: 0 in 0.541s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-44cc7893-f81f-4b5c-8f03-a315127c321c tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-a2826624-dadb-4216-ac46-6683ef02712d-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:58:59 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da
Sep 25 11:58:59 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:58:59 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.132s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:58:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 00f320c3-6026-4fc3-8487-4606ef43dece of volume 365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:00 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Attempting download of de80ad1b-32c6-4513-9751-88499af46eb5 ((None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}])) to volume 4f75c6d4-dd65-4571-81de-2fe397f3251a. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" returned: 0 in 0.327s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7825a9-8cd9-42b8-b645-ae805a5bdd94]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-0dafe79c-8cda-4da8-839b-6f1e40e1c2da" released by "delete_volume" :: held 0.939s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d8e512-f458-4b5a-a624-b66665fc0930]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['f7636ab5-0994-4df0-8c06-7cf2940d19da', 'f47fda69-258e-442a-ae1f-241f40fb8873', 'c9dd3015-c332-4f08-92ee-4c914bf29dc1', '5179bf20-a25c-4e76-b523-e531bfb03465'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:00 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41
Sep 25 11:59:00 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-f6648e80-602d-4707-bd07-14f2ea8286e8-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:00 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y
Sep 25 11:59:00 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-f6648e80-602d-4707-bd07-14f2ea8286e8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:00 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:00 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-quobyte-f6648e80-602d-4707-bd07-14f2ea8286e8" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-f6648e80-602d-4707-bd07-14f2ea8286e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26733c7-7ef9-4817-827d-853220743e7e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack sudo[108116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8
Sep 25 11:59:00 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y" returned: 0 in 0.525s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41" returned: 0 in 0.599s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece 1G
Sep 25 11:59:00 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.420s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-90a55467-44a8-4d39-bc1b-1fc56f931f4a tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-0dafe79c-8cda-4da8-839b-6f1e40e1c2da-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:00 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y
Sep 25 11:59:00 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:00 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8" returned: 0 in 0.479s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:00 devstack sudo[108131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8
Sep 25 11:59:00 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y" returned: 1 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de80ad1b-32c6-4513-9751-88499af46eb5_z5mbo48y' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593709e-64db-448c-afa6-3083135c94e5]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece 1G" returned: 0 in 0.496s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365983a6-6959-46ef-80df-19f49ed15c41 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365983a6-6959-46ef-80df-19f49ed15c41 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece
Sep 25 11:59:01 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-cb182f8e-e4bd-4b3d-951e-573058a742e9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:01 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:59:01 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f6648e80-602d-4707-bd07-14f2ea8286e8" returned: 0 in 0.358s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-cb182f8e-e4bd-4b3d-951e-573058a742e9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-f6648e80-602d-4707-bd07-14f2ea8286e8" released by "delete_volume" :: held 0.903s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-cb182f8e-e4bd-4b3d-951e-573058a742e9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-cb182f8e-e4bd-4b3d-951e-573058a742e9" acquired by "delete_volume" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Created reservations ['8b7aaf43-be31-4c0d-b65f-613a31efe0c5', '2ce8f383-bf1b-49f8-921f-337119cdb580', 'c4c6f1d9-97e4-4bb2-b111-59aaa4937f30', 'ccc76b84-56d5-4261-89bd-d72d564ff995'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f46acb8-0c20-4404-940a-888fa4705617]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:01 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:01 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:01 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365983a6-6959-46ef-80df-19f49ed15c41 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece is being set with open permissions: ugo+rw
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:01 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece
Sep 25 11:59:01 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD
Sep 25 11:59:01 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:01 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.342s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:01 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Deleted volume successfully.
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9" returned: 0 in 0.550s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-11457cf1-78b9-4fe4-9cd9-7ca8180d69de tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-f6648e80-602d-4707-bd07-14f2ea8286e8-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:01 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9
Sep 25 11:59:01 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] de80ad1b-32c6-4513-9751-88499af46eb5 was raw, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info
Sep 25 11:59:02 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a
Sep 25 11:59:02 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cb182f8e-e4bd-4b3d-951e-573058a742e9" returned: 0 in 0.284s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-cb182f8e-e4bd-4b3d-951e-573058a742e9" released by "delete_volume" :: held 0.920s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:02 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info is being set with open permissions: ugo+rw
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['3dbfef72-fff6-4b6c-b3a3-955124cbc18a', '0ae15eb3-122e-4538-837e-09d602fbd71d', 'ba0b3f4e-9649-4d00-a886-cec4c85401b2', '92fc604b-1426-4acb-8670-c8f3a6738f75'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:02 devstack sudo[108176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info
Sep 25 11:59:02 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:02 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-37312b15-e092-467b-b3d3-322a530ae4c4-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:02 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-37312b15-e092-467b-b3d3-322a530ae4c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a" returned: 0 in 0.657s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de80ad1b-32c6-4513-9751-88499af46eb5_in7fsdwzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:59:02 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1G
Sep 25 11:59:02 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "cinder-quobyte-37312b15-e092-467b-b3d3-322a530ae4c4" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:02 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.info" returned: 0 in 0.447s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:02 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-37312b15-e092-467b-b3d3-322a530ae4c4" acquired by "delete_volume" :: waited 0.060s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.377s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eba26e3f-9216-4011-9b2f-727dd4f7e857 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8effdef3-e195-45f7-8364-0bf57c710e0f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3822f225-0daa-4163-b58c-d0fb673a50bd tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-cb182f8e-e4bd-4b3d-951e-573058a742e9-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-00f320c3-6026-4fc3-8487-4606ef43dece-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:03 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4
Sep 25 11:59:03 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-00f320c3-6026-4fc3-8487-4606ef43dece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-00f320c3-6026-4fc3-8487-4606ef43dece" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-00f320c3-6026-4fc3-8487-4606ef43dece" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 00f320c3-6026-4fc3-8487-4606ef43dece of volume 365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a192d96-cf6d-4d76-9b96-b6273f06ccf9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:03 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a 1G" returned: 0 in 0.513s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Downloaded image de80ad1b-32c6-4513-9751-88499af46eb5 ((None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}])) to volume 4f75c6d4-dd65-4571-81de-2fe397f3251a successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Temporary image de80ad1b-32c6-4513-9751-88499af46eb5 for user d6b3c680b48144708794a33b6f8bb460 is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Marking volume 4f75c6d4-dd65-4571-81de-2fe397f3251a as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Copying metadata from image de80ad1b-32c6-4513-9751-88499af46eb5 to 4f75c6d4-dd65-4571-81de-2fe397f3251a. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Creating volume glance metadata for volume 4f75c6d4-dd65-4571-81de-2fe397f3251a backed by image de80ad1b-32c6-4513-9751-88499af46eb5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '03845e42c99314611d953162b300b981', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:59:03 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece
Sep 25 11:59:03 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6236ff7f-942f-470e-94b2-45e1207ac14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f75c6d4-dd65-4571-81de-2fe397f3251a', 'volume_size': 1, 'image_id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de80ad1b-32c6-4513-9751-88499af46eb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03845e42c99314611d953162b300b981', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4599ad23adaa4384b765c8215405bb5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f91eb85daa23f25fb893d5d95d65bbbd02ced1804c9878a9b5af327823e2d9156dd17f3db47c926d4f917fb6c7fe26e7158f32d32487f627760f82b39a6482d5', 'id': 'de80ad1b-32c6-4513-9751-88499af46eb5', 'created_at': datetime.datetime(2026, 9, 25, 9, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de80ad1b-32c6-4513-9751-88499af46eb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8d63de930>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f56b607-d4a6-459b-8d1f-077430e06585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Volume volume-4f75c6d4-dd65-4571-81de-2fe397f3251a (4f75c6d4-dd65-4571-81de-2fe397f3251a): created successfully
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f56b607-d4a6-459b-8d1f-077430e06585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Flow 'volume_create_manager' (467615aa-26a5-4793-8234-328b7e1f8b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:03 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b578ab37-b55a-43bc-80f2-67138c605130 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Created volume successfully.
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4" returned: 0 in 0.590s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:03 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4
Sep 25 11:59:03 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-cc54140b-9434-4a42-bb7d-dfc310150ca8-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-cc54140b-9434-4a42-bb7d-dfc310150ca8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-cc54140b-9434-4a42-bb7d-dfc310150ca8" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-cc54140b-9434-4a42-bb7d-dfc310150ca8" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:03 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[76957f94-bc11-4bfb-a21c-ba2859c1f4a1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece" returned: 0 in 0.550s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-365983a6-6959-46ef-80df-19f49ed15c41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b750de7f-e027-4a7d-8e44-37c81f16038d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:03 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8
Sep 25 11:59:03 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:03 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37312b15-e092-467b-b3d3-322a530ae4c4" returned: 0 in 0.412s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-quobyte-37312b15-e092-467b-b3d3-322a530ae4c4" released by "delete_volume" :: held 1.069s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:03 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41
Sep 25 11:59:03 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Acquiring lock "cinder-4f75c6d4-dd65-4571-81de-2fe397f3251a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "cinder-4f75c6d4-dd65-4571-81de-2fe397f3251a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Created reservations ['8734b046-dc04-409e-a01e-6a1a44259bef', '635018d1-06b5-4dad-a739-38a0556cd33c', 'a39446e5-4cf8-45cb-9502-4548b8f9319a', '629e35f7-1894-415d-b0a2-39b91a8ce29d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Acquiring lock "cinder-quobyte-4f75c6d4-dd65-4571-81de-2fe397f3251a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "cinder-quobyte-4f75c6d4-dd65-4571-81de-2fe397f3251a" acquired by "delete_volume" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af58bb-4e9b-4399-83ca-f224af95b7c1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41" returned: 0 in 0.555s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:04 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:04 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece
Sep 25 11:59:04 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:04 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8" returned: 0 in 0.688s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a
Sep 25 11:59:04 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:04 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8
Sep 25 11:59:04 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:04 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.359s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Deleted volume successfully.
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fee42792-37be-4a79-90f2-ee90c7cdd69e tempest-CreateVolumesFromImageTest-1631539350 None] Lock "cinder-37312b15-e092-467b-b3d3-322a530ae4c4-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:04 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-cc54140b-9434-4a42-bb7d-dfc310150ca8" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a" returned: 0 in 0.552s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-cc54140b-9434-4a42-bb7d-dfc310150ca8" released by "delete_volume" :: held 1.131s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:04 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a
Sep 25 11:59:04 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['e9cef931-2f1e-487d-990d-abf763ef29a4', '76501e8f-14bc-4a04-a603-3f4ca04f1224', '1336c088-26d0-4753-be79-3c0ec2483559', '753dc886-c97a-4816-805c-655197055941'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:04 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece" returned: 0 in 0.554s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:04 devstack sudo[108233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece
Sep 25 11:59:04 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:05 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:05 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:05 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4f75c6d4-dd65-4571-81de-2fe397f3251a" returned: 0 in 0.482s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "cinder-quobyte-4f75c6d4-dd65-4571-81de-2fe397f3251a" released by "delete_volume" :: held 1.109s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41.00f320c3-6026-4fc3-8487-4606ef43dece" returned: 0 in 0.420s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-00f320c3-6026-4fc3-8487-4606ef43dece" released by "_delete_snapshot" :: held 2.249s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" released by "delete_snapshot" :: held 2.288s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Created reservations ['afacd014-639f-43c1-a8c5-aa8a260b89c8', '59c3e708-eaf8-4780-9e99-f0094bb8a034', 'dde0fe8d-5ee8-4da7-8a72-893e2303c76c', '9d5e626a-d0a2-4d3d-b0cb-28df32f03a66'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:05 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.484s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Created reservations ['64f9b6f7-4bd8-49ad-8757-bfc0eea7bd29', '66c5ce4d-232a-4323-8216-1aa85d6a9e5e', '4df8c21b-5f54-4c48-b4af-bd94bf4f24ed', 'bf89e73d-95b6-4755-99b9-905787746e9d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-02b6f42d-9267-4580-986e-f1b33798a470 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-cc54140b-9434-4a42-bb7d-dfc310150ca8-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:05 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:05 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d64c261c-c1ec-48c1-9ba8-1ea870c24896 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-00f320c3-6026-4fc3-8487-4606ef43dece-delete_snapshot" released by "delete_snapshot" :: held 2.595s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-dcd26c79-6b4d-4426-b373-ee74c2aea77a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-dcd26c79-6b4d-4426-b373-ee74c2aea77a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:05 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Deleted volume successfully.
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a7dadb1f-3f96-4833-9889-b178ea3a6023 tempest-VolumeAndVolumeTypeFromImageTest-1660368531 None] Lock "cinder-4f75c6d4-dd65-4571-81de-2fe397f3251a-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-dcd26c79-6b4d-4426-b373-ee74c2aea77a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-dcd26c79-6b4d-4426-b373-ee74c2aea77a" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1801eab-a1b8-44e2-a35e-8abec2349c83]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:06 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a
Sep 25 11:59:06 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-365983a6-6959-46ef-80df-19f49ed15c41-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "cinder-365983a6-6959-46ef-80df-19f49ed15c41-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d55f3-6bce-485f-8b6b-06e20e7b2db3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:06 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a" returned: 0 in 0.687s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:06 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a
Sep 25 11:59:06 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:06 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41
Sep 25 11:59:06 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:07 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41" returned: 0 in 0.703s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:07 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-dcd26c79-6b4d-4426-b373-ee74c2aea77a" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:07 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41
Sep 25 11:59:07 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-dcd26c79-6b4d-4426-b373-ee74c2aea77a" released by "delete_volume" :: held 1.337s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['3324d3da-24e6-4310-a06b-ded6b9394f8d', '05b67d8d-dddd-4d4f-b14c-3c5ff5dc9dd1', '6e0f853b-e1f6-4572-a49a-a1575838574a', '6f6fcf83-c79d-4a48-964d-3305e99193a2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:07 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:07 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:07 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-365983a6-6959-46ef-80df-19f49ed15c41" returned: 0 in 0.433s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-365983a6-6959-46ef-80df-19f49ed15c41" released by "delete_volume" :: held 1.251s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Created reservations ['9f6f4b5b-8e4d-4a0b-ac78-f6f1ccffe8ac', 'f15751b3-b4d5-4ba3-89d7-eecb1b2b3fdf', 'd1e80446-d237-41f2-a357-a32a0845ffc3', '8b418323-05e7-4c2b-8c45-2090afb75dd0'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:07 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:07 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:07 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-68b0f144-8a32-4aeb-ab5e-5c8c0ed60ee0 tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-dcd26c79-6b4d-4426-b373-ee74c2aea77a-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:08 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.362s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-9f389939-dbc3-4edb-b4d1-4660ea68ff9d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-3e0de45d-e85b-45f1-a786-916e39b81ebc tempest-ProjectMemberTests-1491797813 None] Lock "cinder-365983a6-6959-46ef-80df-19f49ed15c41-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-9f389939-dbc3-4edb-b4d1-4660ea68ff9d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892c1c0-fe25-4834-b3b7-be3ea3942d14]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:08 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d
Sep 25 11:59:08 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:09 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" returned: 0 in 0.573s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:09 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d
Sep 25 11:59:09 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:09 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (aed710e2-76e7-45ae-a921-6a4248283135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4abdbf-cbde-47ba-9a85-0bd80c3084ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" returned: 0 in 0.436s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4abdbf-cbde-47ba-9a85-0bd80c3084ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1753909989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70be1885-e579-4701-aa37-b4df22636aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:09Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba07f9e0-cb64-4e06-821b-52bc1ba58464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba07f9e0-cb64-4e06-821b-52bc1ba58464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112c23b8-8794-465c-ada6-f6233e71d02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112c23b8-8794-465c-ada6-f6233e71d02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70be1885-e579-4701-aa37-b4df22636aaf', 'volume_name': 'volume-70be1885-e579-4701-aa37-b4df22636aaf', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7b69b1-24c3-4186-a401-006824d7ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7b69b1-24c3-4186-a401-006824d7ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3778d7-421e-4136-8f54-47a8cc01e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:09 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Volume 70be1885-e579-4701-aa37-b4df22636aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70be1885-e579-4701-aa37-b4df22636aaf', 'volume_size': 1}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1753909989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70be1885-e579-4701-aa37-b4df22636aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:09Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Creating volume 70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:09 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-9f389939-dbc3-4edb-b4d1-4660ea68ff9d" released by "delete_volume" :: held 1.165s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:09 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf 1073741824
Sep 25 11:59:09 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['e1471fd7-ecd8-4396-9502-53282a092781', 'f573ad7d-0515-4768-bc47-6e8df2a085da', 'f77b76d3-d933-4a76-b7a5-e3e1044fbe5e', 'f752bd81-6573-4d05-902c-1a9f65c0eb04'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:09 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:09 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:10 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.440s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-78d81911-3735-4575-a403-6bba557d7bed tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-9f389939-dbc3-4edb-b4d1-4660ea68ff9d-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:10 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf 1073741824" returned: 0 in 0.779s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:10 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf
Sep 25 11:59:10 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (0c23219e-92ad-4a34-abee-08deb0cf3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6409f4-ec4b-4d26-8584-d494fedef288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6409f4-ec4b-4d26-8584-d494fedef288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547471033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c520abcb-ecb7-499a-a2d8-6e3c3950a296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:10Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0af260-7b2a-429f-a68d-e5070ee9b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0af260-7b2a-429f-a68d-e5070ee9b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c60d2e-d231-40a7-91bb-ab6bee1fb8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c60d2e-d231-40a7-91bb-ab6bee1fb8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c520abcb-ecb7-499a-a2d8-6e3c3950a296', 'volume_name': 'volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1aa61c-8680-4308-9607-8454980abc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1aa61c-8680-4308-9607-8454980abc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c8abe-9f4a-4762-a0f9-925f672ed58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:10 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume c520abcb-ecb7-499a-a2d8-6e3c3950a296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296', 'volume_size': 1}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-01602e3f-eaa9-482c-b8a5-d744e22fa2c6-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-01602e3f-eaa9-482c-b8a5-d744e22fa2c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "cinder-quobyte-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a08e6c-a6cc-4241-8209-cc17f965078c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:10 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547471033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c520abcb-ecb7-499a-a2d8-6e3c3950a296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:10Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:11 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3778d7-421e-4136-8f54-47a8cc01e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70be1885-e579-4701-aa37-b4df22636aaf', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:11 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 1073741824
Sep 25 11:59:11 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bc7325-f335-423e-9e49-892cc04aea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:11 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Volume volume-70be1885-e579-4701-aa37-b4df22636aaf (70be1885-e579-4701-aa37-b4df22636aaf): created successfully
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bc7325-f335-423e-9e49-892cc04aea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (aed710e2-76e7-45ae-a921-6a4248283135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3297dfe3-9149-4506-8d14-fa478330f114 tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 11:59:11 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6
Sep 25 11:59:11 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:11 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" returned: 0 in 0.604s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:11 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6
Sep 25 11:59:11 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:11 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 1073741824" returned: 0 in 0.742s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:11 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-quobyte-01602e3f-eaa9-482c-b8a5-d744e22fa2c6" released by "delete_volume" :: held 1.038s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:12 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296
Sep 25 11:59:12 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Created reservations ['05c7fd6c-d3a5-4d1a-a1fc-f66fbbeedf90', '2a7dc16a-273c-4358-9dd3-9b94bebba2dd', '01f83729-c35d-41a4-baac-362ed47f8b59', '2bbeb748-d62a-4a39-8085-cd3898acd566'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:12 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:12 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:12 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.240s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c8abe-9f4a-4762-a0f9-925f672ed58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77e8aa6-bdd8-4377-a7b2-800684febb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 5ad22eda-1c4a-407e-98bf-994f10b71f14 of volume 70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb830d47-9e26-4833-bd17-c791363002e3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 (c520abcb-ecb7-499a-a2d8-6e3c3950a296): created successfully
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77e8aa6-bdd8-4377-a7b2-800684febb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (0c23219e-92ad-4a34-abee-08deb0cf3b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2fb2731e-1f86-44f6-841e-7ba37cfd115c tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:12 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf
Sep 25 11:59:12 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:12 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Deleted volume successfully.
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-57c8b601-a24b-463b-9777-9ab29fa81efa tempest-CreateVolumesFromSourceVolumeTest-1668417523 None] Lock "cinder-01602e3f-eaa9-482c-b8a5-d744e22fa2c6-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:12 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf" returned: 0 in 0.537s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:12 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 1G
Sep 25 11:59:12 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:13 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 1G" returned: 0 in 0.588s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70be1885-e579-4701-aa37-b4df22636aaf -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:13 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70be1885-e579-4701-aa37-b4df22636aaf -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14
Sep 25 11:59:13 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:13 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70be1885-e579-4701-aa37-b4df22636aaf -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14" returned: 0 in 0.361s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:13 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 is being set with open permissions: ugo+rw
Sep 25 11:59:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:13 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14
Sep 25 11:59:13 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:14 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14" returned: 0 in 0.334s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:14 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info
Sep 25 11:59:14 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:15 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info" returned: 0 in 0.276s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:15 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info is being set with open permissions: ugo+rw
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:15 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info
Sep 25 11:59:15 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:15 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.info" returned: 0 in 0.266s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.155s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.703s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating offline snapshot f8a584c8-4f6c-4d71-90fe-4bc0181b1187 of volume c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a000b6d8-eeba-4bc6-8d5b-e453d5cac7ca]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:15 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296
Sep 25 11:59:15 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:15 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296" returned: 0 in 0.393s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:15 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 1G
Sep 25 11:59:15 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:16 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 1G" returned: 0 in 0.444s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:16 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187
Sep 25 11:59:16 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5def8c73-552f-48c3-a985-6825bebe99a8 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 11:59:16 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187" returned: 0 in 0.308s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:16 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 is being set with open permissions: ugo+rw
Sep 25 11:59:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:16 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187
Sep 25 11:59:16 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:16 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187" returned: 0 in 0.255s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:18 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info
Sep 25 11:59:18 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:18 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:18 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info is being set with open permissions: ugo+rw
Sep 25 11:59:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:18 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info
Sep 25 11:59:18 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:18 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.info" returned: 0 in 0.252s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.428s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5616d024-a775-4f84-8c55-d8ab8f272b64 tempest-CreateVolumesFromSnapshotTest-583475180 None] Create snapshot completed successfully
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-5ad22eda-1c4a-407e-98bf-994f10b71f14-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-5ad22eda-1c4a-407e-98bf-994f10b71f14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-5ad22eda-1c4a-407e-98bf-994f10b71f14" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5ad22eda-1c4a-407e-98bf-994f10b71f14" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 5ad22eda-1c4a-407e-98bf-994f10b71f14 of volume 70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d66fa0-ab97-4f1b-8d8c-5b53eb37bc2e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:19 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14
Sep 25 11:59:19 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Flow 'volume_create_manager' (ca4b60af-1bb1-4398-b015-c8be7fe301b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9eaa12-7293-47ea-bd61-fd0dff35d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9eaa12-7293-47ea-bd61-fd0dff35d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1330396891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9ec62b-d6c1-4755-a1cc-b9d611a18516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fbcf0705d74d52a8bc84056ed1bf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:20Z,use_quota=True,user_id='32c8ecc2c7b44c579dd4056779cb9683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3f6cfe-df0c-4c72-b893-9346ccd5b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3f6cfe-df0c-4c72-b893-9346ccd5b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9df429-ba83-4786-87f9-a209e622d67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9df429-ba83-4786-87f9-a209e622d67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9ec62b-d6c1-4755-a1cc-b9d611a18516', 'volume_name': 'volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6955e4b-b5ac-4450-a31a-caef18246698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6955e4b-b5ac-4450-a31a-caef18246698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1dfc9f-cd51-4ea3-97d4-14060891bf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:19 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Volume 8b9ec62b-d6c1-4755-a1cc-b9d611a18516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516', 'volume_size': 1}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1330396891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9ec62b-d6c1-4755-a1cc-b9d611a18516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fbcf0705d74d52a8bc84056ed1bf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:20Z,use_quota=True,user_id='32c8ecc2c7b44c579dd4056779cb9683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Creating volume 8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:19 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:19 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 1073741824
Sep 25 11:59:19 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:20 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14" returned: 0 in 0.638s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70be1885-e579-4701-aa37-b4df22636aaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (7b0d4321-8608-4263-9be5-aad0782aebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84711792-1bb9-450f-9013-147ebbd2246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2b54f-82b3-4467-8974-0e51c7f26a52]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84711792-1bb9-450f-9013-147ebbd2246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589728548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99800297-93ab-4266-956f-804a3035bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:20Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dfdce8-b0e5-48a2-9c16-697965ec7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dfdce8-b0e5-48a2-9c16-697965ec7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ecdd7c-ce96-4767-9988-a454e28481bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ecdd7c-ce96-4767-9988-a454e28481bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99800297-93ab-4266-956f-804a3035bfd7', 'volume_name': 'volume-99800297-93ab-4266-956f-804a3035bfd7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e201601-7854-4e33-b778-219d2c22ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e201601-7854-4e33-b778-219d2c22ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e422d072-008b-4666-ad7a-3babfc2f4de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume 99800297-93ab-4266-956f-804a3035bfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99800297-93ab-4266-956f-804a3035bfd7', 'volume_size': 1}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:20 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf
Sep 25 11:59:20 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:20 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 1073741824" returned: 0 in 0.814s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:20 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:20 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (93a51437-df09-47b0-8964-4140c7b6512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a76b185-cf22-4341-8421-b416c14618c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf" returned: 0 in 0.776s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a76b185-cf22-4341-8421-b416c14618c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897634059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:21Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:20 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6d9530-7efb-48e8-bc2a-b14b6776f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:20 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14
Sep 25 11:59:21 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6d9530-7efb-48e8-bc2a-b14b6776f50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fd893-7efe-4a84-8240-22bf9076d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fd893-7efe-4a84-8240-22bf9076d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9', 'volume_name': 'volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8812f38f-6283-49dd-a9fa-6006579d4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8812f38f-6283-49dd-a9fa-6006579d4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82942ae-c95f-4646-aa62-f8e07caebe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume 3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9', 'volume_size': 1}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:21 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589728548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99800297-93ab-4266-956f-804a3035bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:20Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume 99800297-93ab-4266-956f-804a3035bfd7 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:21 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:21 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 1073741824
Sep 25 11:59:21 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1dfc9f-cd51-4ea3-97d4-14060891bf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99938552-fcc2-4a35-b949-577299e6cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Volume volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 (8b9ec62b-d6c1-4755-a1cc-b9d611a18516): created successfully
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99938552-fcc2-4a35-b949-577299e6cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Flow 'volume_create_manager' (ca4b60af-1bb1-4398-b015-c8be7fe301b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-94f05eb4-1e6f-4a6b-8829-9a6422701967 tempest-VolumeDependencyTests-1019065068 None] Created volume successfully.
Sep 25 11:59:21 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14" returned: 0 in 0.616s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:21 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14
Sep 25 11:59:21 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (f413f289-7c2a-48b7-be7e-d3453490fefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb11a0ad-3f33-4367-93f3-55316cf51d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb11a0ad-3f33-4367-93f3-55316cf51d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515936137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057c8502-a8c2-47e3-90bd-cddb7f6ca523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:22Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd485c93-7f40-4842-958c-4770d8ba8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd485c93-7f40-4842-958c-4770d8ba8147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485098c4-4e4c-4fb9-bf03-956f363ecc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485098c4-4e4c-4fb9-bf03-956f363ecc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '057c8502-a8c2-47e3-90bd-cddb7f6ca523', 'volume_name': 'volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab345a-4be0-4a83-b8b6-abc1cb5bb3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab345a-4be0-4a83-b8b6-abc1cb5bb3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9ecfe3-3f79-40d9-b537-d7956f307c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume 057c8502-a8c2-47e3-90bd-cddb7f6ca523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523', 'volume_size': 1}
Sep 25 11:59:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:22 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf.5ad22eda-1c4a-407e-98bf-994f10b71f14" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:22 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 1073741824" returned: 0 in 0.865s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5ad22eda-1c4a-407e-98bf-994f10b71f14" released by "_delete_snapshot" :: held 2.734s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" released by "delete_snapshot" :: held 2.780s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:22 devstack sudo[108390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7
Sep 25 11:59:22 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Created reservations ['4487e31f-64f7-4cd1-9fe2-816e8b1a54ba', '46acaa85-20b8-4a0f-ba41-c6a1791e97ff', '2d3a41c0-96cb-4a35-8bcc-a65d068e08fb', '897da73a-20b8-421c-bea3-56419b02921b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46b0c8f0-db25-4df5-9ef3-38545bf8de0f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-5ad22eda-1c4a-407e-98bf-994f10b71f14-delete_snapshot" released by "delete_snapshot" :: held 3.217s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (b3fafe1d-b683-4bf8-9c8c-d4a33bf06aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb55878b-5882-45b8-beef-0142cd019094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb55878b-5882-45b8-beef-0142cd019094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927874693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ef7ea0-ab76-458a-9a1e-292416d3ff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:22Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ccbafc-2f7d-4a01-9665-f093cb8373f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ccbafc-2f7d-4a01-9665-f093cb8373f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f22d93e-ddee-4d86-8ae6-2a3b3a92a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f22d93e-ddee-4d86-8ae6-2a3b3a92a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ef7ea0-ab76-458a-9a1e-292416d3ff6d', 'volume_name': 'volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce8c15e-d390-478d-bef6-7e239de89e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce8c15e-d390-478d-bef6-7e239de89e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e974e3b9-75bb-49db-86f8-ae50db1f99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume c1ef7ea0-ab76-458a-9a1e-292416d3ff6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d', 'volume_size': 1}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:22 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7" returned: 0 in 0.475s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897634059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:21Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume 3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:22 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-70be1885-e579-4701-aa37-b4df22636aaf-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e422d072-008b-4666-ad7a-3babfc2f4de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99800297-93ab-4266-956f-804a3035bfd7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb52f06-8b38-4f02-bfad-2732beccd57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:22 devstack sudo[108393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 1073741824
Sep 25 11:59:22 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-70be1885-e579-4701-aa37-b4df22636aaf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-99800297-93ab-4266-956f-804a3035bfd7 (99800297-93ab-4266-956f-804a3035bfd7): created successfully
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb52f06-8b38-4f02-bfad-2732beccd57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (7b0d4321-8608-4263-9be5-aad0782aebc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c2591b55-57fd-4c52-b6c8-af9d389e59de tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0b9e8-e6db-46fa-b909-50a79e8310cb]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:22 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (073818b4-431f-4f46-8084-5c44616de226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fc0b92-27fc-4723-a54b-98afec0bea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf
Sep 25 11:59:23 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fc0b92-27fc-4723-a54b-98afec0bea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799016019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7231b7ac-6d8d-45cb-b0cd-7912923fbc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:23Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856614c-54ae-470c-a815-a4c1def701d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856614c-54ae-470c-a815-a4c1def701d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c959aa41-4c18-4fdb-951c-5bfa241000b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c959aa41-4c18-4fdb-951c-5bfa241000b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7231b7ac-6d8d-45cb-b0cd-7912923fbc5f', 'volume_name': 'volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d792f0ba-4059-4ba5-950d-4fd0aff1351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d792f0ba-4059-4ba5-950d-4fd0aff1351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36482a7-4d02-4110-aaf6-2f6c4c06d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume 7231b7ac-6d8d-45cb-b0cd-7912923fbc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f', 'volume_size': 1}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:23 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 1073741824" returned: 0 in 0.658s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:23 devstack sudo[108404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9
Sep 25 11:59:23 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:23 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf" returned: 0 in 0.521s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:23 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf
Sep 25 11:59:23 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:23 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515936137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057c8502-a8c2-47e3-90bd-cddb7f6ca523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:22Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume 057c8502-a8c2-47e3-90bd-cddb7f6ca523 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:23 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:23 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-70be1885-e579-4701-aa37-b4df22636aaf" returned: 0 in 0.280s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:23 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 1073741824
Sep 25 11:59:23 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82942ae-c95f-4646-aa62-f8e07caebe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc8966-ed0d-4b4a-8dd0-6f6289ba56fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-70be1885-e579-4701-aa37-b4df22636aaf" released by "delete_volume" :: held 0.913s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:23 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 (3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9): created successfully
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc8966-ed0d-4b4a-8dd0-6f6289ba56fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (93a51437-df09-47b0-8964-4140c7b6512b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:23 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c3287818-5505-4a7e-8f19-9a2486e71fec tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Created reservations ['18c8c23b-6fdc-46ca-a6af-97bc06cfdaf9', '11d408be-b37c-4b5a-a564-4f10cc777961', '08754112-062c-470b-859c-5b2ba282937a', 'c011cd66-26aa-4782-95e6-a35c952e7e80'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:24 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:24 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:24 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 1073741824" returned: 0 in 0.622s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:24 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.368s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 11:59:24 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523
Sep 25 11:59:24 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fd9a75e6-5fa1-4c6f-a1b7-67e22d8cacb9 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-70be1885-e579-4701-aa37-b4df22636aaf-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:24 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.418s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Creating offline snapshot cc3f64d4-35e2-4f51-9625-5982d3f98dfd of volume 8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9ecfe3-3f79-40d9-b537-d7956f307c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9e257-37c6-4237-8a6d-1c1c5f7e0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11b4f7-687f-4279-8e1b-14646d64f9fc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (0afea0e5-ff30-4546-8d72-44d088a6d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f498ba0f-2054-4cda-b82d-324aad7da71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 (057c8502-a8c2-47e3-90bd-cddb7f6ca523): created successfully
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9e257-37c6-4237-8a6d-1c1c5f7e0edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (f413f289-7c2a-48b7-be7e-d3453490fefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f498ba0f-2054-4cda-b82d-324aad7da71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131145191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27c3afd-450b-4d89-a0d9-4e425635550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:25Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e741d1-f9f1-47bd-a810-ac0e0fbe2934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e741d1-f9f1-47bd-a810-ac0e0fbe2934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ea8284-7f1e-4361-8e30-9ddbf9d6f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ea8284-7f1e-4361-8e30-9ddbf9d6f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27c3afd-450b-4d89-a0d9-4e425635550d', 'volume_name': 'volume-d27c3afd-450b-4d89-a0d9-4e425635550d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7940c9e7-b51a-4837-9fd7-6189e172e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7940c9e7-b51a-4837-9fd7-6189e172e812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e724f28-18c7-46dd-a49d-37c85f5246ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:24 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Volume d27c3afd-450b-4d89-a0d9-4e425635550d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27c3afd-450b-4d89-a0d9-4e425635550d', 'volume_size': 1}
Sep 25 11:59:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:24 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:24 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a6d3f3b2-8fdb-468d-b8cd-a9a3c1f069a3 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:25 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:25 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd 1G
Sep 25 11:59:25 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:25 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd 1G" returned: 0 in 0.506s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:25 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:25 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:26 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.321s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:26 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd is being set with open permissions: ugo+rw
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:26 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:26 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:26 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.314s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:26 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info
Sep 25 11:59:26 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Flow 'volume_create_manager' (198c8474-384e-4400-b293-97278c4a8f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2252b1c7-e369-4aff-857f-4c3ec490b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2252b1c7-e369-4aff-857f-4c3ec490b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ad55a8-c2e1-4d5a-acf1-7506161c60e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dc76de9f54664a65bf29fafa465f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:27Z,use_quota=True,user_id='57d7d091d4754a8aa13a6363076f9c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286a6a26-c2ad-4846-9ab1-01ddf2b8c625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286a6a26-c2ad-4846-9ab1-01ddf2b8c625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f827df-7706-495b-9d93-8f2775be046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.image.glance [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Creating Keystone auth plugin from conf {{(pid=87358) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 11:59:26 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info" returned: 0 in 0.285s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:26 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info is being set with open permissions: ugo+rw
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:26 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info
Sep 25 11:59:26 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f827df-7706-495b-9d93-8f2775be046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01ad55a8-c2e1-4d5a-acf1-7506161c60e3', 'volume_name': 'volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3', 'volume_size': 1, 'image_id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e22106be21c768ab8f6a4d3e1ee6f710', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e25dc76de9f54664a65bf29fafa465f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339872dac583338c37c2e0e992b24884b10131c4be18116e53bc7bee5d3915496ebbcb85a3f5c74f377fe799f00405868129fdb721c8a0bfd2c519bf89cd38d1', 'id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'created_at': datetime.datetime(2026, 9, 25, 9, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 59, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cbf810a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68738f-a2a0-49af-87f0-2e8776eaf40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68738f-a2a0-49af-87f0-2e8776eaf40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d1b75c-eebe-4d52-909d-f19ace56cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3', 'volume_size': 1, 'image_id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e22106be21c768ab8f6a4d3e1ee6f710', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e25dc76de9f54664a65bf29fafa465f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339872dac583338c37c2e0e992b24884b10131c4be18116e53bc7bee5d3915496ebbcb85a3f5c74f377fe799f00405868129fdb721c8a0bfd2c519bf89cd38d1', 'id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'created_at': datetime.datetime(2026, 9, 25, 9, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 59, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cbf810a0>}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Trying to clone 01ad55a8-c2e1-4d5a-acf1-7506161c60e3 from image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}]). {{(pid=87358) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 11:59:26 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.info" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.378s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927874693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ef7ea0-ab76-458a-9a1e-292416d3ff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:22Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume c1ef7ea0-ab76-458a-9a1e-292416d3ff6d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:27 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:27 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d 1073741824
Sep 25 11:59:27 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 11:59:27 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 11:59:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-2236c075-99cf-468d-a136-9d951eb9cf46 tempest-VolumeDependencyTests-1019065068 None] Create snapshot completed successfully
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c3deac-6dd4-4d1c-b682-8e0cbab15f60]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:27 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:27 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:27 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:27 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d 1073741824" returned: 0 in 0.618s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:27 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:27 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:27 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d
Sep 25 11:59:27 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:27 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:27 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Temporary image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 is fetched for user 57d7d091d4754a8aa13a6363076f9c3c. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 11:59:28 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.972s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799016019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7231b7ac-6d8d-45cb-b0cd-7912923fbc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf666d8e7bab43c991eb640109fe9a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:23Z,use_quota=True,user_id='23932d24bda6431d933227d37291e56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Creating volume 7231b7ac-6d8d-45cb-b0cd-7912923fbc5f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:28 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:28 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f 1073741824
Sep 25 11:59:28 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e974e3b9-75bb-49db-86f8-ae50db1f99ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019ff6b2-9a7e-4a7b-bdc5-bd3b7893f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Flow 'volume_create_manager' (5a8bd0b5-f7ca-44c8-b203-df56cf4dea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355e239d-02c9-4120-9418-a0ff5815b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d (c1ef7ea0-ab76-458a-9a1e-292416d3ff6d): created successfully
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019ff6b2-9a7e-4a7b-bdc5-bd3b7893f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (b3fafe1d-b683-4bf8-9c8c-d4a33bf06aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355e239d-02c9-4120-9418-a0ff5815b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-119039681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5d84ce-cfd8-4779-9346-1d2540d0c31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fbcf0705d74d52a8bc84056ed1bf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc3f64d4-35e2-4f51-9625-5982d3f98dfd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:28Z,use_quota=True,user_id='32c8ecc2c7b44c579dd4056779cb9683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b795a9b-5b41-4a18-91ad-a2e8fc937d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b795a9b-5b41-4a18-91ad-a2e8fc937d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d39137-122a-4129-a2a8-d3006a74c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d39137-122a-4129-a2a8-d3006a74c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa5d84ce-cfd8-4779-9346-1d2540d0c31c', 'volume_name': 'volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c', 'volume_size': 1, 'snapshot_id': 'cc3f64d4-35e2-4f51-9625-5982d3f98dfd'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec10f82-c949-4416-b45d-313247dfc881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec10f82-c949-4416-b45d-313247dfc881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c6569e-ad41-47c8-9c44-1cb11551461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:28 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Volume aa5d84ce-cfd8-4779-9346-1d2540d0c31c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c', 'volume_size': 1, 'snapshot_id': 'cc3f64d4-35e2-4f51-9625-5982d3f98dfd'}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea3c54-89bb-4f99-afca-60b27a2d91e1]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cb40006e-e870-4f96-8bdd-6dc81e82d403 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:28 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:28 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:28 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f 1073741824" returned: 0 in 0.538s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=147,cinder:UPDATE=172,cinder:INSERT=46,cinder:DELETE=19 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:28 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f
Sep 25 11:59:28 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:28 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:28 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:28 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:28 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" returned: 0 in 0.290s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.089s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131145191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27c3afd-450b-4d89-a0d9-4e425635550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:25Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Creating volume d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:28 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36482a7-4d02-4110-aaf6-2f6c4c06d515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:29 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d 1073741824
Sep 25 11:59:29 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02bb63-de9e-43cd-a256-c48bbd09e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Volume volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f (7231b7ac-6d8d-45cb-b0cd-7912923fbc5f): created successfully
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02bb63-de9e-43cd-a256-c48bbd09e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Flow 'volume_create_manager' (073818b4-431f-4f46-8084-5c44616de226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b15c1a6d-773b-4902-96e7-a944088a0f32 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created volume successfully.
Sep 25 11:59:29 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:29 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d 1073741824" returned: 0 in 0.538s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:29 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d
Sep 25 11:59:29 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716cc7b-6b63-4975-bf4c-4c250eeb88da]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:29 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d" returned: 0 in 0.321s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.580s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e724f28-18c7-46dd-a49d-37c85f5246ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27c3afd-450b-4d89-a0d9-4e425635550d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697a6aae-16a0-4aef-987d-98350517a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Creating volume aa5d84ce-cfd8-4779-9346-1d2540d0c31c from snapshot cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:29 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Volume volume-d27c3afd-450b-4d89-a0d9-4e425635550d (d27c3afd-450b-4d89-a0d9-4e425635550d): created successfully
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697a6aae-16a0-4aef-987d-98350517a20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (0afea0e5-ff30-4546-8d72-44d088a6d192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] snapshot: cc3f64d4-35e2-4f51-9625-5982d3f98dfd, volume: aa5d84ce-cfd8-4779-9346-1d2540d0c31c,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 11:59:29 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8dd24eea-96c1-4017-a289-f2d208a01e97 tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 11:59:29 devstack sudo[108493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f
Sep 25 11:59:29 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7983804-7188-419e-ba0c-2a6699a2fbe7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:30 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:30 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:30 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" returned: 0 in 0.527s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:30 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f
Sep 25 11:59:30 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:30 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.445s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[394aed79-a236-4174-ba57-972cb4f423e8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:30 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:30 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:30 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f" released by "delete_volume" :: held 0.910s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['00cfea90-440b-49a1-8619-7c3381b9178b', '55656432-88b5-4859-a06c-3cc351888da6', '603ff473-2739-4998-a8bb-2170ac16e626', '76b268af-dd37-4167-922e-631cb138500e'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:30 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:30 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:30 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.434s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 11:59:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:30 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c
Sep 25 11:59:30 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:31 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.347s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:31 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-358bd7ff-e57d-493b-af5c-c7bf88e0fc85 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-7231b7ac-6d8d-45cb-b0cd-7912923fbc5f-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:31 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c4dde6-9dc2-49e2-b7b2-9a538d2732c4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:32 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d
Sep 25 11:59:32 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:32 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" returned: 0 in 0.552s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:32 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d
Sep 25 11:59:32 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:33 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" returned: 0 in 0.385s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d" released by "delete_volume" :: held 1.036s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['d981c91c-3d32-4577-8dfa-c1d6a131800d', '01175fb1-88f8-4c56-bb16-880cd4b32443', '8e71ff34-cbc0-48aa-a9b0-0a0727a5c602', '793e6fde-d4e5-418c-9be7-501de587c761'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:33 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:33 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:33 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d19f1623-9dce-4e3c-9483-204e145bba5e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-c1ef7ea0-ab76-458a-9a1e-292416d3ff6d-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-057c8502-a8c2-47e3-90bd-cddb7f6ca523-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-057c8502-a8c2-47e3-90bd-cddb7f6ca523-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-057c8502-a8c2-47e3-90bd-cddb7f6ca523" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-057c8502-a8c2-47e3-90bd-cddb7f6ca523" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a0715-68ff-482d-8f28-694309ae2b0d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:34 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523
Sep 25 11:59:34 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:35 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523" returned: 0 in 0.829s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:35 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523
Sep 25 11:59:35 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:35 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-057c8502-a8c2-47e3-90bd-cddb7f6ca523" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-057c8502-a8c2-47e3-90bd-cddb7f6ca523" released by "delete_volume" :: held 1.341s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['0bd75202-495a-4526-b2f7-b06b427e5a17', '9989adfa-7170-4505-8633-44e18145ebb6', '2ef262f9-98bd-4dec-8105-5ad934aaa3ac', '21506242-c510-45ee-9e88-19705f9fcc03'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:36 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:36 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:36 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.473s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:36 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c2738693-73ac-46d6-a788-2636248b0349 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-057c8502-a8c2-47e3-90bd-cddb7f6ca523-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" acquired by "delete_volume" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afb77f-2a15-467a-aae4-4ddfdac003d9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:37 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9
Sep 25 11:59:37 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:37 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" returned: 0 in 0.605s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:37 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" returned: 0 in 6.937s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:37 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9
Sep 25 11:59:37 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:59:37 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Converted 1024.00 MB image at 147.59 MB/s
Sep 25 11:59:37 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c is being set with open permissions: ugo+rw
Sep 25 11:59:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:37 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c
Sep 25 11:59:37 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:38 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" returned: 0 in 0.252s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9" released by "delete_volume" :: held 0.937s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=243,cinder:SELECT=166,cinder:INSERT=60,cinder:DELETE=21 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 11:59:38 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" released by "_copy_volume_from_snapshot" :: held 8.223s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['dae2368b-b319-4711-a807-5fb8cc947d51', '0699d90f-582b-46e9-b451-7c66efb5a99c', '8a354616-1205-4bdb-b93c-ec8eb168a685', '5437dc5d-e2f1-416f-913e-94d93288b036'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" released by "_create_volume_from_snapshot" :: held 8.326s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.360s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.098s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ad55a8-c2e1-4d5a-acf1-7506161c60e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dc76de9f54664a65bf29fafa465f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:27Z,use_quota=True,user_id='57d7d091d4754a8aa13a6363076f9c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Creating volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:38 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:38 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1073741824
Sep 25 11:59:38 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c6569e-ad41-47c8-9c44-1cb11551461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c', 'volume_size': 1, 'snapshot_id': 'cc3f64d4-35e2-4f51-9625-5982d3f98dfd'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c45dcd8-3394-4b08-b1e1-a69034cb84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:38 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Volume volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c (aa5d84ce-cfd8-4779-9346-1d2540d0c31c): created successfully
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c45dcd8-3394-4b08-b1e1-a69034cb84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Flow 'volume_create_manager' (5a8bd0b5-f7ca-44c8-b203-df56cf4dea8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:38 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-22c62f9c-bacd-4023-9f0f-1f13f6525a5f tempest-VolumeDependencyTests-1019065068 None] Created volume successfully.
Sep 25 11:59:38 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:38 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:38 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-79902feb-b51d-4198-ac4c-9941676c2e2e tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-3ed49bdc-a9e2-42a9-9c12-d13a2e5347a9-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:38 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1073741824" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:38 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3
Sep 25 11:59:38 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:38 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:39 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.686s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot db3bf277-444a-458b-9656-dd177dff23b1 of volume d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Deleting offline snapshot cc3f64d4-35e2-4f51-9625-5982d3f98dfd of volume 8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] snapshot_file for this snap is: volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8c747-3763-4a43-9f63-3e44d710e71a]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Attempting download of 4a64e36e-b202-4082-b6d7-286dcc2a08d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}])) to volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cbd040-697b-4c89-a162-199582d2e6a6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1bda79-a862-47b1-b2fe-a1e53654af9f]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d
Sep 25 11:59:39 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:39 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d
Sep 25 11:59:39 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-99800297-93ab-4266-956f-804a3035bfd7-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-99800297-93ab-4266-956f-804a3035bfd7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-99800297-93ab-4266-956f-804a3035bfd7" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-99800297-93ab-4266-956f-804a3035bfd7" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e13f327-e83d-4257-b71e-a552fed17f44]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.485s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:39 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d" returned: 0 in 0.545s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41b824-d638-4a09-bd9e-7a77b59cd3f0]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:39 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7
Sep 25 11:59:39 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack sudo[108594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 1G
Sep 25 11:59:39 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d" returned: 0 in 0.499s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:39 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d
Sep 25 11:59:39 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:39 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:39 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7" returned: 0 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7
Sep 25 11:59:40 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d" returned: 1 in 0.469s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a64e36e-b202-4082-b6d7-286dcc2a08d3_g2t1875d' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b41fb0-ecfb-4d41-8cb3-200e4043382c]: (4, 'raw') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 1G" returned: 0 in 0.536s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27c3afd-450b-4d89-a0d9-4e425635550d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27c3afd-450b-4d89-a0d9-4e425635550d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1
Sep 25 11:59:40 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:40 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-99800297-93ab-4266-956f-804a3035bfd7" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-99800297-93ab-4266-956f-804a3035bfd7" released by "delete_volume" :: held 0.863s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:40 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['d37b3fcb-691f-45cf-9f9f-69d985e19348', '70662934-824c-4802-810e-daa2cabc71ab', 'fe2c23ad-99a0-4848-bb83-0994347e0846', '6fd3d6ef-e0e2-42eb-88df-97fecd99ff8d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.775s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:40 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:40 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27c3afd-450b-4d89-a0d9-4e425635550d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1" returned: 0 in 0.439s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 is being set with open permissions: ugo+rw
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1
Sep 25 11:59:40 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-f8a584c8-4f6c-4d71-90fe-4bc0181b1187-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-f8a584c8-4f6c-4d71-90fe-4bc0181b1187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-f8a584c8-4f6c-4d71-90fe-4bc0181b1187" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-f8a584c8-4f6c-4d71-90fe-4bc0181b1187" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleting offline snapshot f8a584c8-4f6c-4d71-90fe-4bc0181b1187 of volume c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] snapshot_file for this snap is: volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f77483-8e31-456b-a701-ee5d8eeaa6f4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:40 devstack sudo[108630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD
Sep 25 11:59:40 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:40 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.418s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:40 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:40 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:41 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187
Sep 25 11:59:41 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.581s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-eda25bf3-5826-4896-8002-e0cf68329a19 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-99800297-93ab-4266-956f-804a3035bfd7-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1" returned: 0 in 0.411s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd
Sep 25 11:59:41 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack sudo[108643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info
Sep 25 11:59:41 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD" returned: 1 in 0.604s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] 4a64e36e-b202-4082-b6d7-286dcc2a08d3 was raw, converting to qcow2 {{(pid=87358) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack sudo[108650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3
Sep 25 11:59:41 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516.cc3f64d4-35e2-4f51-9625-5982d3f98dfd" returned: 0 in 0.365s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187" returned: 0 in 0.568s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:41 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ec548-05a0-4a80-8c04-5df0bc36fad8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info" returned: 0 in 0.399s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info is being set with open permissions: ugo+rw
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-cc3f64d4-35e2-4f51-9625-5982d3f98dfd" released by "_delete_snapshot" :: held 2.407s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" released by "delete_snapshot" :: held 2.449s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:41 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info
Sep 25 11:59:41 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296
Sep 25 11:59:41 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Created reservations ['6d9e533f-d757-4391-907c-2eab3b06913e', 'cdf66642-e53d-4662-bcbb-57fb6207c77d', '78da8ac0-da02-4a0c-b8c0-51c4c656fcfa', '643fc574-e799-4876-a5c2-829742080852'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Delete snapshot completed successfully.
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b061f713-9753-4b1c-a34c-926ccdbaa1a6 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-cc3f64d4-35e2-4f51-9625-5982d3f98dfd-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:41 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.info" returned: 0 in 0.327s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e14dba4d-9aa5-4767-9540-8c683a3fa164 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 11:59:41 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" returned: 0 in 0.660s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a64e36e-b202-4082-b6d7-286dcc2a08d3_rxxdwkkbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 11:59:41 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 11:59:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:41 devstack sudo[108667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1G
Sep 25 11:59:41 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296" returned: 0 in 0.556s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack sudo[108669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187
Sep 25 11:59:42 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-db3bf277-444a-458b-9656-dd177dff23b1-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-db3bf277-444a-458b-9656-dd177dff23b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-db3bf277-444a-458b-9656-dd177dff23b1" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-db3bf277-444a-458b-9656-dd177dff23b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot db3bf277-444a-458b-9656-dd177dff23b1 of volume d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01f039-d07e-439c-97bd-9a87ad4eb8df]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-8b9ec62b-d6c1-4755-a1cc-b9d611a18516-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-8b9ec62b-d6c1-4755-a1cc-b9d611a18516-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:42 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1
Sep 25 11:59:42 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 1G" returned: 0 in 0.472s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Downloaded image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}])) to volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3 successfully. {{(pid=87358) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Temporary image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 for user 57d7d091d4754a8aa13a6363076f9c3c is deleted. {{(pid=87358) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.volume_utils [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Marking volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3 as bootable. {{(pid=87358) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864f207-966a-44b0-b736-8abe1f326b15]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Copying metadata from image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 to 01ad55a8-c2e1-4d5a-acf1-7506161c60e3. {{(pid=87358) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Creating volume glance metadata for volume 01ad55a8-c2e1-4d5a-acf1-7506161c60e3 backed by image 4a64e36e-b202-4082-b6d7-286dcc2a08d3 with: {'image_id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e22106be21c768ab8f6a4d3e1ee6f710', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87358) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187
Sep 25 11:59:42 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d1b75c-eebe-4d52-909d-f19ace56cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3', 'volume_size': 1, 'image_id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e22106be21c768ab8f6a4d3e1ee6f710', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e25dc76de9f54664a65bf29fafa465f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339872dac583338c37c2e0e992b24884b10131c4be18116e53bc7bee5d3915496ebbcb85a3f5c74f377fe799f00405868129fdb721c8a0bfd2c519bf89cd38d1', 'id': '4a64e36e-b202-4082-b6d7-286dcc2a08d3', 'created_at': datetime.datetime(2026, 9, 25, 9, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 59, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a64e36e-b202-4082-b6d7-286dcc2a08d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79d8cbf810a0>}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:42 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138d1dfb-8259-4f6c-a2d7-500edf43982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:42 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Volume volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 (01ad55a8-c2e1-4d5a-acf1-7506161c60e3): created successfully
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138d1dfb-8259-4f6c-a2d7-500edf43982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Flow 'volume_create_manager' (198c8474-384e-4400-b293-97278c4a8f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-74c4c8bf-9ae1-4d45-9679-78d71d9c6e85 tempest-VolumeImageDependencyTests-1924891787 None] Created volume successfully.
Sep 25 11:59:42 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1" returned: 0 in 0.505s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d27c3afd-450b-4d89-a0d9-4e425635550d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[101b5aa0-d508-4dea-a276-f16a170ee1f7]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296.f8a584c8-4f6c-4d71-90fe-4bc0181b1187" returned: 0 in 0.301s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-f8a584c8-4f6c-4d71-90fe-4bc0181b1187" released by "_delete_snapshot" :: held 2.029s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" released by "delete_snapshot" :: held 2.060s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:42 devstack sudo[108688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d
Sep 25 11:59:42 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['8ece4398-aa90-480b-8228-a65562e9f1b6', '3e01f94f-8398-41e5-bebb-a95001460892', 'f5208414-d92d-47d5-a780-dffe16820f1c', 'bd8018af-c1a1-4a99-bfd4-dd6897532e1f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:42 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:42 devstack sudo[108693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516
Sep 25 11:59:42 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Delete snapshot completed successfully.
Sep 25 11:59:42 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-238320e4-7688-49ab-b6ae-b1fd5d39e780 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-f8a584c8-4f6c-4d71-90fe-4bc0181b1187-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:43 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" returned: 0 in 0.311s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:43 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1
Sep 25 11:59:43 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-8b9ec62b-d6c1-4755-a1cc-b9d611a18516" released by "delete_volume" :: held 0.879s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Acquiring lock "cinder-01ad55a8-c2e1-4d5a-acf1-7506161c60e3-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "cinder-01ad55a8-c2e1-4d5a-acf1-7506161c60e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Acquiring lock "cinder-quobyte-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Created reservations ['6c353376-1341-4e46-b9ad-ae6b0f6c9e92', 'a3348613-2767-447b-a6b3-161628dcb02f', '0a69c0b7-d4db-40f0-877e-b8e258986f10', 'accb4431-44ae-4672-8e97-f85462cb9388'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "cinder-quobyte-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce2902b-801d-4cae-bb97-2b4992036cde]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-aa5d84ce-cfd8-4779-9346-1d2540d0c31c-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:43 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:43 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-aa5d84ce-cfd8-4779-9346-1d2540d0c31c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:43 devstack sudo[108701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3
Sep 25 11:59:43 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[579770fd-b88a-4a3f-96a8-86e73b233dea]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1" returned: 0 in 0.490s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack sudo[108709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1
Sep 25 11:59:43 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:43 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c
Sep 25 11:59:43 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:43 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Deleted volume successfully.
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ec77b25e-f781-42d7-94a1-509e3e6e51d3 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-8b9ec62b-d6c1-4755-a1cc-b9d611a18516-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:43 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" returned: 0 in 0.512s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:43 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3
Sep 25 11:59:43 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-c520abcb-ecb7-499a-a2d8-6e3c3950a296-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:44 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d.db3bf277-444a-458b-9656-dd177dff23b1" returned: 0 in 0.339s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-c520abcb-ecb7-499a-a2d8-6e3c3950a296-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-db3bf277-444a-458b-9656-dd177dff23b1" released by "_delete_snapshot" :: held 1.946s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" released by "delete_snapshot" :: held 1.979s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:44 devstack sudo[108723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c
Sep 25 11:59:44 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" acquired by "delete_volume" :: waited 0.042s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:44 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" returned: 0 in 0.308s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ee8bd-17f8-489e-bbce-c22ff41216f1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "cinder-quobyte-01ad55a8-c2e1-4d5a-acf1-7506161c60e3" released by "delete_volume" :: held 0.898s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Created reservations ['21eabd56-be1f-45ca-a126-581b828ec804', '4fe5f9b8-4632-48b2-b72e-38ab14b7dbec', 'eb1736f2-05c5-4e83-9dc9-235a61e5eb32', '0a0d4ba3-76ea-4434-a53c-9503a8978488'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Created reservations ['bc8121c5-7699-4196-896d-5b9fd93a5007', '6a9aacc0-1fcf-4d42-b868-be6d480e3565', '5383c13d-abbf-4be4-b089-2ff510b4a77b', '6b345780-991d-4831-80bb-c84387bceb76'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:44 devstack sudo[108726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296
Sep 25 11:59:44 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-431d05e9-d802-4fa5-80d4-51e3a7a3cf28 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-db3bf277-444a-458b-9656-dd177dff23b1-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-quobyte-aa5d84ce-cfd8-4779-9346-1d2540d0c31c" released by "delete_volume" :: held 0.854s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:44 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Created reservations ['c48a11e0-6fe2-4a17-a8a4-65a9eed99125', '6e25c630-7a6f-402c-99c3-6669771249e5', '7790b614-a1fd-48a1-9d9d-18b2ee0420c1', '52a885ca-48f3-4236-adde-ad0be4399701'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:44 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:44 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296" returned: 0 in 0.455s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:44 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296
Sep 25 11:59:44 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:44 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.320s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Deleted volume successfully.
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6db40dda-311c-4f68-bee3-a037875658e2 tempest-VolumeImageDependencyTests-1924891787 None] Lock "cinder-01ad55a8-c2e1-4d5a-acf1-7506161c60e3-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:44 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:44 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Deleted volume successfully.
Sep 25 11:59:44 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-c520abcb-ecb7-499a-a2d8-6e3c3950a296" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-586ffcfe-0b85-48d2-a890-748967d0b7a0 tempest-VolumeDependencyTests-1019065068 None] Lock "cinder-aa5d84ce-cfd8-4779-9346-1d2540d0c31c-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-quobyte-c520abcb-ecb7-499a-a2d8-6e3c3950a296" released by "delete_volume" :: held 0.845s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Created reservations ['6e882d69-7366-494a-9dc4-f091ab48a8df', '3ddcf8e0-9043-4d7f-ac16-46a0931936ce', '25f34cd8-1481-494d-8462-85f2d9d49ec7', '69865bf5-87f5-4b64-902f-701818d23a09'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:45 devstack sudo[108741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:45 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-d27c3afd-450b-4d89-a0d9-4e425635550d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-d27c3afd-450b-4d89-a0d9-4e425635550d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301ce86-3b8d-46fa-81f2-096f02b544d9]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:45 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.398s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Deleted volume successfully.
Sep 25 11:59:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-56a3944c-0afe-4bf2-8aa8-8564c75a1363 tempest-CreateVolumesFromSnapshotTest-583475180 None] Lock "cinder-c520abcb-ecb7-499a-a2d8-6e3c3950a296-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:45 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d
Sep 25 11:59:45 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:46 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d" returned: 0 in 0.507s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:46 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d
Sep 25 11:59:46 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:46 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d27c3afd-450b-4d89-a0d9-4e425635550d" returned: 0 in 0.382s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-d27c3afd-450b-4d89-a0d9-4e425635550d" released by "delete_volume" :: held 1.014s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Created reservations ['6802b699-e807-4636-b042-7c9bb00dc9da', 'caa404b8-df63-4621-b38c-a8e43eafc578', '16c3c77a-b039-4f8f-8a9f-b53936f8ff41', 'a0442c07-65da-406e-ba3f-4914015c48a1'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:46 devstack sudo[108753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:46 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:46 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.350s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:46 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 11:59:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fa10fe3c-cc18-44bb-885a-3df11664e3cb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-d27c3afd-450b-4d89-a0d9-4e425635550d-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (89b3d137-ba7f-4b23-a9eb-61caf3b7423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f966cabb-3704-461e-a6f6-ce10eeeb2eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f966cabb-3704-461e-a6f6-ce10eeeb2eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193334625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f61c0c-7c4f-469f-8f06-f7fb86830709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:48Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91916f19-de37-4325-b979-066f7e95e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91916f19-de37-4325-b979-066f7e95e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaaa78e-8a6d-44ec-af09-e21c45e8074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaaa78e-8a6d-44ec-af09-e21c45e8074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f61c0c-7c4f-469f-8f06-f7fb86830709', 'volume_name': 'volume-68f61c0c-7c4f-469f-8f06-f7fb86830709', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6977dd-e02c-4c4a-b5e9-86757728ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6977dd-e02c-4c4a-b5e9-86757728ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09159128-9117-4b8d-ab80-3faa2d9203d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:48 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Volume 68f61c0c-7c4f-469f-8f06-f7fb86830709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f61c0c-7c4f-469f-8f06-f7fb86830709', 'volume_size': 1}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193334625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f61c0c-7c4f-469f-8f06-f7fb86830709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:48Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Creating volume 68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:48 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:48 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 1073741824
Sep 25 11:59:48 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:48 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 1073741824" returned: 0 in 0.528s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:49 devstack sudo[108763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709
Sep 25 11:59:49 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:49 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709" returned: 0 in 0.317s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09159128-9117-4b8d-ab80-3faa2d9203d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f61c0c-7c4f-469f-8f06-f7fb86830709', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcd7da5-e09c-4ccf-9666-55e9861aff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:49 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Volume volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 (68f61c0c-7c4f-469f-8f06-f7fb86830709): created successfully
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcd7da5-e09c-4ccf-9666-55e9861aff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:49 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (89b3d137-ba7f-4b23-a9eb-61caf3b7423e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1de089da-0305-4e13-8181-b976205fa23e tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 11:59:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot ed93f137-b681-4d31-8efd-c7c33b3beb20 of volume 68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:50 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034fbb5-5d43-4fcd-aa25-d32141699449]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:50 devstack sudo[108766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709
Sep 25 11:59:50 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:51 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709" returned: 0 in 0.541s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:51 devstack sudo[108771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 1G
Sep 25 11:59:51 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:51 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:51 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Flow 'volume_create_manager' (cd2b5cac-ca30-4f9e-8317-dfc1cd1f8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f104eed0-dca3-4538-862d-6fa6e3f55455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f104eed0-dca3-4538-862d-6fa6e3f55455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6164deb694e48826282cb82301193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:51Z,use_quota=True,user_id='75106b91c4bb4d5abf357ad7ea6ca865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444a8059-3c1c-468e-aeb3-a3cde38b5602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444a8059-3c1c-468e-aeb3-a3cde38b5602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a689994b-4d80-409f-8920-eb7093174a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a689994b-4d80-409f-8920-eb7093174a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d', 'volume_name': 'volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd16f36-5b52-4396-9201-bfbf3dcf1113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd16f36-5b52-4396-9201-bfbf3dcf1113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a6f86e-2b3e-47ce-bd9e-d222ae2e5f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Volume 4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d', 'volume_size': 1}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-8ecbd399-e5fb-40f8-b496-56518af45768 tempest-ProjectAdminTests-2032882992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4321403503418, 'free_capacity_gb': 1775.4321403503418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87358) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 11:59:51 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 1G" returned: 0 in 0.690s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:51 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20
Sep 25 11:59:51 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:51 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.421s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 11:59:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (12ed2eeb-17f7-46f7-b7bf-8f9e8deddb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee217f9d-3913-4b1b-98b0-1a33db902590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee217f9d-3913-4b1b-98b0-1a33db902590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41327828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d10022-8e1d-4936-829d-68c204c68b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:52Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1d8f3-4c32-4249-8e2a-34276ec9fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1d8f3-4c32-4249-8e2a-34276ec9fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab122f4-6d0d-4fa5-98e1-377ad19a95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab122f4-6d0d-4fa5-98e1-377ad19a95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d10022-8e1d-4936-829d-68c204c68b7f', 'volume_name': 'volume-79d10022-8e1d-4936-829d-68c204c68b7f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a195310-9e1d-4e24-8896-557b3c325028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a195310-9e1d-4e24-8896-557b3c325028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0860e5e-d381-4f7b-8d83-1439bb836714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:52 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Volume 79d10022-8e1d-4936-829d-68c204c68b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d10022-8e1d-4936-829d-68c204c68b7f', 'volume_size': 1}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:52 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20" returned: 0 in 0.402s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:52 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 is being set with open permissions: ugo+rw
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:52 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20
Sep 25 11:59:52 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:52 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20" returned: 0 in 0.281s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:52 devstack sudo[108787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info
Sep 25 11:59:52 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:52 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:52 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info is being set with open permissions: ugo+rw
Sep 25 11:59:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:52 devstack sudo[108790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info
Sep 25 11:59:52 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:53 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.info" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6164deb694e48826282cb82301193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:51Z,use_quota=True,user_id='75106b91c4bb4d5abf357ad7ea6ca865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Creating volume 4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:53 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:53 devstack sudo[108793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d 1073741824
Sep 25 11:59:53 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:53 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-061d92fa-f3ba-46b6-b551-de28e962078e tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 11:59:53 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d 1073741824" returned: 0 in 0.548s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:53 devstack sudo[108800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d
Sep 25 11:59:53 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-ed93f137-b681-4d31-8efd-c7c33b3beb20-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ed93f137-b681-4d31-8efd-c7c33b3beb20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-ed93f137-b681-4d31-8efd-c7c33b3beb20" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ed93f137-b681-4d31-8efd-c7c33b3beb20" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:53 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot ed93f137-b681-4d31-8efd-c7c33b3beb20 of volume 68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099b90d-edea-4894-b989-be2b07e288a5]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:54 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" returned: 0 in 0.346s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41327828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d10022-8e1d-4936-829d-68c204c68b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:52Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Creating volume 79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:54 devstack sudo[108802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20
Sep 25 11:59:54 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:54 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a6f86e-2b3e-47ce-bd9e-d222ae2e5f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:54 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f 1073741824
Sep 25 11:59:54 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375ca26f-45a8-47a7-b5e9-3b6c8643e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:54 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Volume volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d (4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d): created successfully
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375ca26f-45a8-47a7-b5e9-3b6c8643e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Flow 'volume_create_manager' (cd2b5cac-ca30-4f9e-8317-dfc1cd1f8011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:54 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6b137d90-1a19-4b22-b30c-49c50579468e tempest-CinderUnicodeTest-326693155 None] Created volume successfully.
Sep 25 11:59:54 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68f61c0c-7c4f-469f-8f06-f7fb86830709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa6d24-c5f2-484b-9c45-1da48f658a37]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:54 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709
Sep 25 11:59:54 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:54 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f 1073741824" returned: 0 in 0.514s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:54 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:54 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f
Sep 25 11:59:54 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:55 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709" returned: 0 in 0.499s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:55 devstack sudo[108822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20
Sep 25 11:59:55 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:55 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f" returned: 0 in 0.371s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0860e5e-d381-4f7b-8d83-1439bb836714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d10022-8e1d-4936-829d-68c204c68b7f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6f9442-3f27-4456-93c8-eef91ef52389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Volume volume-79d10022-8e1d-4936-829d-68c204c68b7f (79d10022-8e1d-4936-829d-68c204c68b7f): created successfully
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6f9442-3f27-4456-93c8-eef91ef52389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (12ed2eeb-17f7-46f7-b7bf-8f9e8deddb84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:55 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d3feb639-2136-4bab-9099-b6b7b038342c tempest-ProjectReaderTests-258975071 None] Created volume successfully.
Sep 25 11:59:55 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20" returned: 0 in 0.516s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:55 devstack sudo[108828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20
Sep 25 11:59:55 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Flow 'volume_create_manager' (c7df0a92-503b-4914-a919-58675d2465d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2c5b08-5f9e-46e8-a4c5-09849570a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2c5b08-5f9e-46e8-a4c5-09849570a05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-6387298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d7778-a274-488a-9e4b-2a6be5a54720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6164deb694e48826282cb82301193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:56Z,use_quota=True,user_id='75106b91c4bb4d5abf357ad7ea6ca865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d0720b-fcff-49a8-ab50-09b1680d3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d0720b-fcff-49a8-ab50-09b1680d3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743db4af-d7e3-4bb3-bb65-4d35cfbce8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743db4af-d7e3-4bb3-bb65-4d35cfbce8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437d7778-a274-488a-9e4b-2a6be5a54720', 'volume_name': 'volume-437d7778-a274-488a-9e4b-2a6be5a54720', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722418dc-4ea7-4c7f-8247-a059cc53bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722418dc-4ea7-4c7f-8247-a059cc53bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767d0f53-09bf-4787-879f-00fb2d1440d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:55 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Volume 437d7778-a274-488a-9e4b-2a6be5a54720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437d7778-a274-488a-9e4b-2a6be5a54720', 'volume_size': 1}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T09:59:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-6387298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d7778-a274-488a-9e4b-2a6be5a54720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6164deb694e48826282cb82301193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:59:56Z,use_quota=True,user_id='75106b91c4bb4d5abf357ad7ea6ca865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Creating volume 437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 11:59:55 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:55 devstack sudo[108845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 1073741824
Sep 25 11:59:55 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:55 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709.ed93f137-b681-4d31-8efd-c7c33b3beb20" returned: 0 in 0.313s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ed93f137-b681-4d31-8efd-c7c33b3beb20" released by "_delete_snapshot" :: held 1.950s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:55 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" released by "delete_snapshot" :: held 1.990s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Created reservations ['bcf6c6b6-9f38-45ad-8d78-66f07d0ad74a', 'd61ba8e0-e74a-4bc8-a936-8bc73a883acb', '37f6de96-f272-4a69-8150-a80d8c5a066d', 'a3e21b67-6ffe-4f5c-b53b-965dd6adaa2c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-9f3f6eab-a05a-4330-acd7-5bf5ef8ef936 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ed93f137-b681-4d31-8efd-c7c33b3beb20-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:56 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 1073741824" returned: 0 in 0.697s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:56 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720
Sep 25 11:59:56 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:56 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.200s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767d0f53-09bf-4787-879f-00fb2d1440d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437d7778-a274-488a-9e4b-2a6be5a54720', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ba58d9-435b-476f-aa9a-3e9fcefa7e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Creating offline snapshot 1eb27559-d513-418a-bf54-ba5572c98cb9 of volume 79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:56 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Volume volume-437d7778-a274-488a-9e4b-2a6be5a54720 (437d7778-a274-488a-9e4b-2a6be5a54720): created successfully
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ba58d9-435b-476f-aa9a-3e9fcefa7e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Flow 'volume_create_manager' (c7df0a92-503b-4914-a919-58675d2465d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87f7ab-d461-4b26-ad17-950ab32afb4d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:56 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:56 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-1eac100a-dafb-48fe-a283-e52c226d8bef tempest-CinderUnicodeTest-326693155 None] Created volume successfully.
Sep 25 11:59:57 devstack sudo[108878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f
Sep 25 11:59:57 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-68f61c0c-7c4f-469f-8f06-f7fb86830709-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-68f61c0c-7c4f-469f-8f06-f7fb86830709-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 11:59:57 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f" returned: 0 in 0.453s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4708895-832c-4410-b3f1-f1e55a35c168]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:57 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 1G
Sep 25 11:59:57 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:57 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709
Sep 25 11:59:57 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:57 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709" returned: 0 in 0.485s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:57 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709
Sep 25 11:59:57 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:57 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 1G" returned: 0 in 0.619s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d10022-8e1d-4936-829d-68c204c68b7f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:58 devstack sudo[108897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d10022-8e1d-4936-829d-68c204c68b7f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9
Sep 25 11:59:58 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:58 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-68f61c0c-7c4f-469f-8f06-f7fb86830709" returned: 0 in 0.348s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-68f61c0c-7c4f-469f-8f06-f7fb86830709" released by "delete_volume" :: held 0.932s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Created reservations ['6e1b8ca1-2798-4365-811b-b3f862dd5ed0', '4230567f-22cc-4892-a782-c92e73c9778d', '5cf2069d-7d04-4fda-b4eb-697eb9c055a8', '98d1e62b-4bde-4b6a-a78a-5d31d4b5f669'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:58 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d10022-8e1d-4936-829d-68c204c68b7f -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9" returned: 0 in 0.472s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:58 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 is being set with open permissions: ugo+rw
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:58 devstack sudo[108903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 11:59:58 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:58 devstack sudo[108904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9
Sep 25 11:59:58 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:58 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.296s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 11:59:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6154757d-9304-4584-aafa-6e92f1614f35 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-68f61c0c-7c4f-469f-8f06-f7fb86830709-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 11:59:58 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9" returned: 0 in 0.311s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:58 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info
Sep 25 11:59:58 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:59 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info" returned: 0 in 0.255s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:59 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info is being set with open permissions: ugo+rw
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:59 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info
Sep 25 11:59:59 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:59 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.info" returned: 0 in 0.279s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.169s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Creating offline snapshot e4812304-3134-449e-b017-1bc08db304a6 of volume 437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f8babe-bf3e-4fab-a8d8-85c0e7ed4df3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-04d92abc-f42c-45c2-9bf4-0bebbf00118e tempest-ProjectReaderTests-258975071 None] Create snapshot completed successfully
Sep 25 11:59:59 devstack sudo[108915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720
Sep 25 11:59:59 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 11:59:59 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 11:59:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 11:59:59 devstack sudo[108920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 1G
Sep 25 11:59:59 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (44d90952-2e3c-4178-8bc0-fffc5fc24f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433347d9-5171-49f5-8b98-5f9165a2f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433347d9-5171-49f5-8b98-5f9165a2f209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975105957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172224df-497c-4684-8da4-3b43ce7ed2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:00Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e3e88e-704b-49f6-8535-b8b793772e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e3e88e-704b-49f6-8535-b8b793772e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038852eb-e0d3-4312-970e-0990a8458d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038852eb-e0d3-4312-970e-0990a8458d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172224df-497c-4684-8da4-3b43ce7ed2d4', 'volume_name': 'volume-172224df-497c-4684-8da4-3b43ce7ed2d4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f002c7-4d76-4000-9784-ad7c442d9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f002c7-4d76-4000-9784-ad7c442d9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83b371d-0a46-439c-94ee-734ec0f4037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:00 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Volume 172224df-497c-4684-8da4-3b43ce7ed2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172224df-497c-4684-8da4-3b43ce7ed2d4', 'volume_size': 1}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-1eb27559-d513-418a-bf54-ba5572c98cb9-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-1eb27559-d513-418a-bf54-ba5572c98cb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-1eb27559-d513-418a-bf54-ba5572c98cb9" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-1eb27559-d513-418a-bf54-ba5572c98cb9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Deleting offline snapshot 1eb27559-d513-418a-bf54-ba5572c98cb9 of volume 79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] snapshot_file for this snap is: volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a93532-5b6f-4385-9f20-590e76584cae]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:00 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 1G" returned: 0 in 0.606s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437d7778-a274-488a-9e4b-2a6be5a54720 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:00 devstack sudo[108925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9
Sep 25 12:00:00 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:00 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437d7778-a274-488a-9e4b-2a6be5a54720 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6
Sep 25 12:00:00 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:00 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9" returned: 0 in 0.483s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:00 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d10022-8e1d-4936-829d-68c204c68b7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437d7778-a274-488a-9e4b-2a6be5a54720 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6" returned: 0 in 0.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:00 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 is being set with open permissions: ugo+rw
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d1d67-a667-4f5a-99c2-851fb44c172e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:00 devstack sudo[108936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6
Sep 25 12:00:00 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack sudo[108937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f
Sep 25 12:00:01 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6" returned: 0 in 0.276s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:01 devstack sudo[108941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info
Sep 25 12:00:01 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f" returned: 0 in 0.466s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:01 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9
Sep 25 12:00:01 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info" returned: 0 in 0.342s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:01 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info is being set with open permissions: ugo+rw
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:01 devstack sudo[108949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info
Sep 25 12:00:01 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:01 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9" returned: 0 in 0.506s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.info" returned: 0 in 0.326s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:01 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9
Sep 25 12:00:01 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975105957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172224df-497c-4684-8da4-3b43ce7ed2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:00Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Creating volume 172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:01 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:01 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 1073741824
Sep 25 12:00:01 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:01 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-254d4f5e-edf9-4658-84d4-0fbfb5265bb7 tempest-CinderUnicodeTest-326693155 None] Create snapshot completed successfully
Sep 25 12:00:02 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f.1eb27559-d513-418a-bf54-ba5572c98cb9" returned: 0 in 0.356s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-1eb27559-d513-418a-bf54-ba5572c98cb9" released by "_delete_snapshot" :: held 1.946s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" released by "delete_snapshot" :: held 1.989s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Created reservations ['381dc8ae-0094-4804-952b-4ca95c3bd12e', 'c4e4d279-d1e4-4c0f-8f7b-4a04035f3d36', 'd2c0e95b-64b0-4943-a162-943ddbb8bc80', '8baf9d8a-73fe-42d1-a9d2-31489bc3fb08'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Delete snapshot completed successfully.
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-e4812304-3134-449e-b017-1bc08db304a6-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b539983b-3d86-42d9-8660-4bef8a22c975 tempest-ProjectReaderTests-258975071 None] Lock "cinder-1eb27559-d513-418a-bf54-ba5572c98cb9-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-e4812304-3134-449e-b017-1bc08db304a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-quobyte-e4812304-3134-449e-b017-1bc08db304a6" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-e4812304-3134-449e-b017-1bc08db304a6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Deleting offline snapshot e4812304-3134-449e-b017-1bc08db304a6 of volume 437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] snapshot_file for this snap is: volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10907f7-8f38-4a08-a41a-a7bea257d578]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:02 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 1073741824" returned: 0 in 0.677s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:02 devstack sudo[108965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4
Sep 25 12:00:02 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:02 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6
Sep 25 12:00:02 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:02 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83b371d-0a46-439c-94ee-734ec0f4037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172224df-497c-4684-8da4-3b43ce7ed2d4', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4414810-b4a1-4ed4-83cd-f7acbda868da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:03 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Volume volume-172224df-497c-4684-8da4-3b43ce7ed2d4 (172224df-497c-4684-8da4-3b43ce7ed2d4): created successfully
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4414810-b4a1-4ed4-83cd-f7acbda868da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (44d90952-2e3c-4178-8bc0-fffc5fc24f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:03 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7e8f7063-d023-432a-95ee-bde6a6fea6f7 tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437d7778-a274-488a-9e4b-2a6be5a54720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ebdb1a-c2f7-4c95-a0cc-6f0d1fe59af5]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:03 devstack sudo[108972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720
Sep 25 12:00:03 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-79d10022-8e1d-4936-829d-68c204c68b7f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot ff82b0bc-0a37-4e69-9cd4-8b5980585e17 of volume 172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "cinder-79d10022-8e1d-4936-829d-68c204c68b7f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb9f11-ee70-4e4f-9a6a-8b23b2c3e553]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:03 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720" returned: 0 in 0.575s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:03 devstack sudo[108979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6
Sep 25 12:00:03 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:03 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe75fd1-4aff-4db4-a580-9d751da2e34d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:03 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:03 devstack sudo[108982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f
Sep 25 12:00:03 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:04 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6" returned: 0 in 0.460s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:04 devstack sudo[108993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6
Sep 25 12:00:04 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:04 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4" returned: 0 in 0.554s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:04 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 1G
Sep 25 12:00:04 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:04 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f" returned: 0 in 0.535s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:04 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f
Sep 25 12:00:04 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:04 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720.e4812304-3134-449e-b017-1bc08db304a6" returned: 0 in 0.389s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-e4812304-3134-449e-b017-1bc08db304a6" released by "_delete_snapshot" :: held 2.057s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" released by "delete_snapshot" :: held 2.090s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:04 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-79d10022-8e1d-4936-829d-68c204c68b7f" returned: 0 in 0.331s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-79d10022-8e1d-4936-829d-68c204c68b7f" released by "delete_volume" :: held 0.964s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Created reservations ['ddc1219e-0abb-477c-8138-abccf6249ca6', 'b28b0734-120b-4691-92dc-b6ce721d1b77', '771f5a81-86d9-49d3-a516-970ad07ff72e', 'a7ff0e25-9c33-4fb3-813b-44bf36fe64b2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Created reservations ['07fc4155-7385-4da9-91cc-6666790db7af', 'c3a8ce73-2bce-4744-924f-6feeabcd57b1', 'fb11a934-2957-4be9-8df7-28223a0ae5e1', 'f4a2ce78-1bc1-4e55-bdc0-9ae46ab00518'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:04 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 1G" returned: 0 in 0.629s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172224df-497c-4684-8da4-3b43ce7ed2d4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:04 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172224df-497c-4684-8da4-3b43ce7ed2d4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17
Sep 25 12:00:04 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Delete snapshot completed successfully.
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-fe263567-7d8b-482a-86d2-93f965aacda3 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-e4812304-3134-449e-b017-1bc08db304a6-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:04 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:04 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:05 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172224df-497c-4684-8da4-3b43ce7ed2d4 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:05 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 is being set with open permissions: ugo+rw
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:05 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.299s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Deleted volume successfully.
Sep 25 12:00:05 devstack sudo[109015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17
Sep 25 12:00:05 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c278c23d-8a16-420e-9410-e453254b3558 tempest-ProjectReaderTests-258975071 None] Lock "cinder-79d10022-8e1d-4936-829d-68c204c68b7f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:05 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17" returned: 0 in 0.289s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:05 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info
Sep 25 12:00:05 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-437d7778-a274-488a-9e4b-2a6be5a54720-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-437d7778-a274-488a-9e4b-2a6be5a54720-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e02a45d-4f5f-475b-aa14-938613494cc4]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:05 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:05 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info is being set with open permissions: ugo+rw
Sep 25 12:00:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:05 devstack sudo[109022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info
Sep 25 12:00:05 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:06 devstack sudo[109021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720
Sep 25 12:00:06 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:06 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.info" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-533b4216-7068-4ffa-9f73-9fb631869907 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 12:00:06 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720" returned: 0 in 0.560s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:06 devstack sudo[109032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720
Sep 25 12:00:06 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (01f5259f-c778-408f-9d7c-ff37dda8e0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a25e069-7907-4ffb-bc3d-599d923502a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a25e069-7907-4ffb-bc3d-599d923502a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175269094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55f1d98-ad7e-4339-922e-bfa85a25bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:07Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fb5f1-4dc1-4108-ac63-341d8e4a9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fb5f1-4dc1-4108-ac63-341d8e4a9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14b4ff-488c-42b8-aeb1-15bcd39ed596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14b4ff-488c-42b8-aeb1-15bcd39ed596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55f1d98-ad7e-4339-922e-bfa85a25bf08', 'volume_name': 'volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6f597c-8715-4a67-af59-4e3918e18091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6f597c-8715-4a67-af59-4e3918e18091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aef783-1389-43e5-9fc5-f0fedc530d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Volume b55f1d98-ad7e-4339-922e-bfa85a25bf08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08', 'volume_size': 1}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175269094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55f1d98-ad7e-4339-922e-bfa85a25bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:07Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Creating volume b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:06 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:06 devstack sudo[109034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 1073741824
Sep 25 12:00:06 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-ff82b0bc-0a37-4e69-9cd4-8b5980585e17-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ff82b0bc-0a37-4e69-9cd4-8b5980585e17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-ff82b0bc-0a37-4e69-9cd4-8b5980585e17" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ff82b0bc-0a37-4e69-9cd4-8b5980585e17" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot ff82b0bc-0a37-4e69-9cd4-8b5980585e17 of volume 172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:06 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-437d7778-a274-488a-9e4b-2a6be5a54720" returned: 0 in 0.430s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a70862-0a6d-4474-b48e-5a2caf6798a2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-437d7778-a274-488a-9e4b-2a6be5a54720" released by "delete_volume" :: held 1.084s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Created reservations ['d879844f-320a-49bd-bf27-4200a887516a', 'a7bd7f00-388d-4554-a135-da6c3c159c77', 'fd90b899-c4f7-41c1-8a48-9bcab9a1a8cd', 'ed747d49-63d2-4383-aaed-cc80c979fab1'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:07 devstack sudo[109037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17
Sep 25 12:00:07 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:07 devstack sudo[109042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:07 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:07 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17" returned: 0 in 0.447s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-172224df-497c-4684-8da4-3b43ce7ed2d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:07 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 1073741824" returned: 0 in 0.703s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc108304-cb98-436a-83b7-188b5e1cd185]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:07 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.335s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Deleted volume successfully.
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-316ca964-a911-4d25-9bf6-25143a214d04 tempest-CinderUnicodeTest-326693155 None] Lock "cinder-437d7778-a274-488a-9e4b-2a6be5a54720-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:07 devstack sudo[109051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08
Sep 25 12:00:07 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:07 devstack sudo[109050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4
Sep 25 12:00:07 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:07 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08" returned: 0 in 0.303s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aef783-1389-43e5-9fc5-f0fedc530d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ad92c-00d4-400e-9f16-a6c16c79f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Volume volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 (b55f1d98-ad7e-4339-922e-bfa85a25bf08): created successfully
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ad92c-00d4-400e-9f16-a6c16c79f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (01f5259f-c778-408f-9d7c-ff37dda8e0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0994894f-0816-44ea-b3b2-b60867de45e7 tempest-ProjectReaderTests-258975071 None] Created volume successfully.
Sep 25 12:00:07 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4" returned: 0 in 0.495s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:07 devstack sudo[109058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17
Sep 25 12:00:07 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "cinder-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Acquiring lock "cinder-quobyte-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e29ac-c24e-4e94-bd74-7fba734f1f50]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:08 devstack sudo[109061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d
Sep 25 12:00:08 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:08 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17" returned: 0 in 0.420s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:08 devstack sudo[109065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17
Sep 25 12:00:08 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:08 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4.ff82b0bc-0a37-4e69-9cd4-8b5980585e17" returned: 0 in 0.293s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:08 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" returned: 0 in 0.498s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ff82b0bc-0a37-4e69-9cd4-8b5980585e17" released by "_delete_snapshot" :: held 1.829s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" released by "delete_snapshot" :: held 1.860s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:08 devstack sudo[109071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d
Sep 25 12:00:08 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Created reservations ['58153944-04a4-4e98-bea0-7a7412e54ff6', '3c034884-6c4a-49c9-b57a-7d81d379cb27', '626b1528-0923-4d55-9a7e-a15e3d1d0e2a', 'bc2dc221-1f49-4c5d-ba13-3e62031c25dd'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-4380b802-83bb-4632-aa81-b8955ebdd1e4 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ff82b0bc-0a37-4e69-9cd4-8b5980585e17-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Creating offline snapshot ac06e908-9fb7-4f3c-b1ae-cdd535d19906 of volume b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:08 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0d3f2-e46c-4d88-8743-b4d197761e0c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "cinder-quobyte-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d" released by "delete_volume" :: held 0.900s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-172224df-497c-4684-8da4-3b43ce7ed2d4-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "cinder-172224df-497c-4684-8da4-3b43ce7ed2d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Created reservations ['925d01d7-6e34-41b9-bfd5-62a90123c8a2', '3456ce78-1a3d-43d4-b7f2-4a42480ef1f3', '416d5c84-b987-4b28-a2e7-8311a90ef3f1', 'b14f52d5-3b8b-4153-bf70-d204ee81be61'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:09 devstack sudo[109074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08
Sep 25 12:00:09 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" acquired by "delete_volume" :: waited 0.046s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463acb3-9b9c-4d76-9011-6b38a6b488be]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:09 devstack sudo[109077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:09 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:09 devstack sudo[109076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4
Sep 25 12:00:09 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:09 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08" returned: 0 in 0.518s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:09 devstack sudo[109083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 1G
Sep 25 12:00:09 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:09 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.379s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:09 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Deleted volume successfully.
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-21255a8d-b263-4b81-92e7-9a8447aac5ce tempest-CinderUnicodeTest-326693155 None] Lock "cinder-4a5c798d-37fe-414a-ac6b-f0b71dcd0b9d-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:09 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4" returned: 0 in 0.571s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:09 devstack sudo[109091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4
Sep 25 12:00:09 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:10 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 1G" returned: 0 in 0.603s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:10 devstack sudo[109095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906
Sep 25 12:00:10 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:10 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-172224df-497c-4684-8da4-3b43ce7ed2d4" returned: 0 in 0.372s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-172224df-497c-4684-8da4-3b43ce7ed2d4" released by "delete_volume" :: held 1.050s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Created reservations ['8717870f-55fd-4382-b631-44881409bdbb', 'eaa8790e-9fc0-47d7-adfc-625120d8a694', '40c21167-0e3e-4a60-b0d6-739fec67f653', 'e34369d4-594e-4b58-8267-9d389beaabeb'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:10 devstack sudo[109100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:10 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:10 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906" returned: 0 in 0.477s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:10 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 is being set with open permissions: ugo+rw
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:10 devstack sudo[109103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906
Sep 25 12:00:10 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:10 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c3cab7e6-05be-4f88-b8af-49a9135df9be tempest-ProjectMemberTests-1491797813 None] Lock "cinder-172224df-497c-4684-8da4-3b43ce7ed2d4-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:10 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906" returned: 0 in 0.331s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:11 devstack sudo[109107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info
Sep 25 12:00:11 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:11 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info" returned: 0 in 0.348s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:11 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info is being set with open permissions: ugo+rw
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:11 devstack sudo[109110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info
Sep 25 12:00:11 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:11 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.info" returned: 0 in 0.361s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0b5538b7-80ef-426c-a712-3050023c29ff tempest-ProjectReaderTests-258975071 None] Create snapshot completed successfully
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (bc957d4a-ea84-4c4b-93ab-ad1c15975043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfa1954-b1ed-4afc-b3c3-036300cf5e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:11 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfa1954-b1ed-4afc-b3c3-036300cf5e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356422204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c440bf-8a1a-40ef-aae0-3e52f3262410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:12Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027ee757-1023-4eaf-b2d9-7da3f22192e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027ee757-1023-4eaf-b2d9-7da3f22192e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f5549e-84d4-419e-9564-e246279851db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f5549e-84d4-419e-9564-e246279851db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c440bf-8a1a-40ef-aae0-3e52f3262410', 'volume_name': 'volume-37c440bf-8a1a-40ef-aae0-3e52f3262410', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23942fbf-2c08-408b-be32-2505e53fabff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23942fbf-2c08-408b-be32-2505e53fabff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbce55ab-36a2-4155-99a3-157975d4481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:12 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Volume 37c440bf-8a1a-40ef-aae0-3e52f3262410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c440bf-8a1a-40ef-aae0-3e52f3262410', 'volume_size': 1}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356422204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c440bf-8a1a-40ef-aae0-3e52f3262410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:12Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Creating volume 37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:12 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:12 devstack sudo[109116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 1073741824
Sep 25 12:00:12 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-ac06e908-9fb7-4f3c-b1ae-cdd535d19906-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-ac06e908-9fb7-4f3c-b1ae-cdd535d19906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-ac06e908-9fb7-4f3c-b1ae-cdd535d19906" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-ac06e908-9fb7-4f3c-b1ae-cdd535d19906" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Deleting offline snapshot ac06e908-9fb7-4f3c-b1ae-cdd535d19906 of volume b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] snapshot_file for this snap is: volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aab39c-3f53-4ba8-bfad-915d08be1600]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:12 devstack sudo[109118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906
Sep 25 12:00:12 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:12 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 1073741824" returned: 0 in 0.597s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:12 devstack sudo[109124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410
Sep 25 12:00:12 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:12 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906" returned: 0 in 0.505s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105c3af-589c-411a-8f2d-df814c561619]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:12 devstack sudo[109129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08
Sep 25 12:00:12 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:13 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410" returned: 0 in 0.322s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbce55ab-36a2-4155-99a3-157975d4481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c440bf-8a1a-40ef-aae0-3e52f3262410', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdddc9e3-8466-43cc-829d-6475e0f436bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:13 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Volume volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 (37c440bf-8a1a-40ef-aae0-3e52f3262410): created successfully
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdddc9e3-8466-43cc-829d-6475e0f436bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (bc957d4a-ea84-4c4b-93ab-ad1c15975043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:13 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-25591885-cef3-4415-9683-3e72bdaa49e8 tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 12:00:13 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08" returned: 0 in 0.496s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:13 devstack sudo[109135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906
Sep 25 12:00:13 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:13 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906" returned: 0 in 0.391s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:13 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:13 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906
Sep 25 12:00:13 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:14 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08.ac06e908-9fb7-4f3c-b1ae-cdd535d19906" returned: 0 in 0.328s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-ac06e908-9fb7-4f3c-b1ae-cdd535d19906" released by "_delete_snapshot" :: held 1.880s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" released by "delete_snapshot" :: held 1.926s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Created reservations ['146e9633-0f92-4449-9f7e-09f6b407a3a2', '577da1ad-3267-4db8-85f4-4a3878510ec7', '5fb184e1-91a7-4a6f-b744-1277eb92823b', '31aed596-11e1-409f-8cc1-c34162226f23'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 30f84657-5dae-40ba-9b4e-356fa7cb282a of volume 37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99ade1-31bd-4e89-8108-14c155c77d3c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:14 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Delete snapshot completed successfully.
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-cec1bc02-8f9e-4c3f-a042-5296bdb447f0 tempest-ProjectReaderTests-258975071 None] Lock "cinder-ac06e908-9fb7-4f3c-b1ae-cdd535d19906-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:14 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410
Sep 25 12:00:14 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:14 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410" returned: 0 in 0.435s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:14 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:14 devstack sudo[109149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a 1G
Sep 25 12:00:14 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:15 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a 1G" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:15 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a
Sep 25 12:00:15 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-b55f1d98-ad7e-4339-922e-bfa85a25bf08-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "cinder-b55f1d98-ad7e-4339-922e-bfa85a25bf08-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa80d210-3803-4061-baca-839ed6d568ed]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:15 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a" returned: 0 in 0.368s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:15 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a is being set with open permissions: ugo+rw
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:15 devstack sudo[109161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a
Sep 25 12:00:15 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:15 devstack sudo[109160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08
Sep 25 12:00:15 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:15 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a" returned: 0 in 0.261s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:15 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info
Sep 25 12:00:15 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:15 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08" returned: 0 in 0.408s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:15 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:16 devstack sudo[109170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08
Sep 25 12:00:16 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:16 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info" returned: 0 in 0.301s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:16 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info is being set with open permissions: ugo+rw
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:16 devstack sudo[109174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info
Sep 25 12:00:16 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:16 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-b55f1d98-ad7e-4339-922e-bfa85a25bf08" returned: 0 in 0.305s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-b55f1d98-ad7e-4339-922e-bfa85a25bf08" released by "delete_volume" :: held 0.788s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Created reservations ['96d0b49f-d031-46d1-9aa0-913bbc510905', 'a025a422-d6d7-4a09-a2ba-20d8da34f8d6', 'cfede382-7928-47fc-b579-c5fdf09888bb', '561563d9-b198-4514-bf20-a3f946d6df5c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:16 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:16 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:16 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.info" returned: 0 in 0.364s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-7e105b10-005a-42cb-8f0d-4c5ac60a6c37 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 12:00:16 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.381s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:16 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Deleted volume successfully.
Sep 25 12:00:16 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-e986221c-2f78-4809-be6b-8209c1be2c12 tempest-ProjectReaderTests-258975071 None] Lock "cinder-b55f1d98-ad7e-4339-922e-bfa85a25bf08-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (336376e5-8499-49cb-8397-52731152191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a1ac57-15e3-4070-8810-a4180a629b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a1ac57-15e3-4070-8810-a4180a629b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425134936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c6d45c-f3cc-4202-b790-452a3ed9b59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:17Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a113d93-5e4f-4732-825f-bb62e0bbb733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a113d93-5e4f-4732-825f-bb62e0bbb733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57dab3-9617-42c6-ac0c-8715750956dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57dab3-9617-42c6-ac0c-8715750956dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c6d45c-f3cc-4202-b790-452a3ed9b59d', 'volume_name': 'volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfa6113-3e93-4d75-bd2a-e92359404784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfa6113-3e93-4d75-bd2a-e92359404784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6287f945-09ba-47df-9483-9d2a0e32c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:17 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Volume d9c6d45c-f3cc-4202-b790-452a3ed9b59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d', 'volume_size': 1}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425134936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c6d45c-f3cc-4202-b790-452a3ed9b59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:17Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Creating volume d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:17 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:17 devstack sudo[109181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d 1073741824
Sep 25 12:00:17 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-30f84657-5dae-40ba-9b4e-356fa7cb282a-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-30f84657-5dae-40ba-9b4e-356fa7cb282a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-30f84657-5dae-40ba-9b4e-356fa7cb282a" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-30f84657-5dae-40ba-9b4e-356fa7cb282a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 30f84657-5dae-40ba-9b4e-356fa7cb282a of volume 37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[145cd414-4b12-4a86-beee-cf33139bbdd6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:17 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a
Sep 25 12:00:17 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:17 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d 1073741824" returned: 0 in 0.572s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:17 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:18 devstack sudo[109192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d
Sep 25 12:00:18 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:18 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a" returned: 0 in 0.445s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37c440bf-8a1a-40ef-aae0-3e52f3262410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b27cbf-f0de-4e70-b667-6af2c26978be]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:18 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410
Sep 25 12:00:18 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:18 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" returned: 0 in 0.292s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6287f945-09ba-47df-9483-9d2a0e32c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d87bc6a-8d7b-4e33-ad6a-7e79edbc303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:18 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Volume volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d (d9c6d45c-f3cc-4202-b790-452a3ed9b59d): created successfully
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d87bc6a-8d7b-4e33-ad6a-7e79edbc303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (336376e5-8499-49cb-8397-52731152191a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:18 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-e86d42e6-1d4a-4474-8302-6358d14b164b tempest-ProjectReaderTests-258975071 None] Created volume successfully.
Sep 25 12:00:18 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:18 devstack sudo[109200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a
Sep 25 12:00:18 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:18 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a" returned: 0 in 0.331s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:18 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:18 devstack sudo[109205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a
Sep 25 12:00:18 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:19 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410.30f84657-5dae-40ba-9b4e-356fa7cb282a" returned: 0 in 0.248s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-30f84657-5dae-40ba-9b4e-356fa7cb282a" released by "_delete_snapshot" :: held 1.548s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" released by "delete_snapshot" :: held 1.573s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Created reservations ['1670411b-f84d-495e-a5b7-2334fedbc6f4', '8aceb11f-a96a-4372-b8af-5c6ac37e508c', '08d24a46-ed1d-44a3-ae84-9c123301c70a', 'a7a900e7-d922-45cc-997b-02c623e11fa0'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:19 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-34df632b-f73b-4a55-8187-21bdf1bc47e2 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-30f84657-5dae-40ba-9b4e-356fa7cb282a-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Creating offline snapshot 520b4dde-79c8-4285-a84f-7f6e5d567498 of volume d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c5d3c-4254-4be6-9298-9403f136f4bf]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-37c440bf-8a1a-40ef-aae0-3e52f3262410-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:19 devstack sudo[109208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d
Sep 25 12:00:19 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-37c440bf-8a1a-40ef-aae0-3e52f3262410-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c11001-f625-45e4-802b-02abab06791d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:19 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:19 devstack sudo[109210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410
Sep 25 12:00:19 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:20 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" returned: 0 in 0.457s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:20 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 1G
Sep 25 12:00:20 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:20 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410" returned: 0 in 0.427s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:20 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410
Sep 25 12:00:20 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:20 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 1G" returned: 0 in 0.468s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:20 devstack sudo[109227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498
Sep 25 12:00:20 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:20 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-37c440bf-8a1a-40ef-aae0-3e52f3262410" returned: 0 in 0.300s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-37c440bf-8a1a-40ef-aae0-3e52f3262410" released by "delete_volume" :: held 0.804s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Created reservations ['39d3bf63-049f-4ed0-ab8d-26474bbe859c', '4041f096-9383-49cc-ae47-4a21b4621bb6', '51b95a08-bb3e-4cb8-aa21-33b8633a3d9e', '90f79195-1be3-4a65-aa25-6df277f3472d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:20 devstack sudo[109229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:20 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:20 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498" returned: 0 in 0.362s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:20 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 is being set with open permissions: ugo+rw
Sep 25 12:00:20 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:20 devstack sudo[109234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498
Sep 25 12:00:20 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:21 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.315s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a0a25948-5569-4899-be8e-164722785ceb tempest-ProjectMemberTests-1491797813 None] Lock "cinder-37c440bf-8a1a-40ef-aae0-3e52f3262410-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:21 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498" returned: 0 in 0.328s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:21 devstack sudo[109238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info
Sep 25 12:00:21 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (ef058214-5de3-4be4-be27-0d9d89316199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b360a5-7698-4faa-a6f0-20f0e31e2053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b360a5-7698-4faa-a6f0-20f0e31e2053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437267977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5442aadf-9021-4ac2-b8a3-6877e3cedb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:21Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684f52d0-9a8a-4bfd-b8fe-38dac3a6897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684f52d0-9a8a-4bfd-b8fe-38dac3a6897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d783af-7475-436c-b410-d28ce3a7394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d783af-7475-436c-b410-d28ce3a7394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5442aadf-9021-4ac2-b8a3-6877e3cedb66', 'volume_name': 'volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95677271-e335-487f-9bf2-61e369f34b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95677271-e335-487f-9bf2-61e369f34b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1ecc8-f0c5-4cea-8f5c-bdbca2d06e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:21 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Volume 5442aadf-9021-4ac2-b8a3-6877e3cedb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66', 'volume_size': 1}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:21 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info" returned: 0 in 0.332s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:21 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info is being set with open permissions: ugo+rw
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:21 devstack sudo[109241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info
Sep 25 12:00:21 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:21 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.info" returned: 0 in 0.289s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437267977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5442aadf-9021-4ac2-b8a3-6877e3cedb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:21Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Creating volume 5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:21 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:21 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:21 devstack sudo[109244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 1073741824
Sep 25 12:00:21 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:21 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ab429d6c-53af-4d0e-a610-d7ddda259cfe tempest-ProjectReaderTests-258975071 None] Create snapshot completed successfully
Sep 25 12:00:22 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 1073741824" returned: 0 in 0.478s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:22 devstack sudo[109249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66
Sep 25 12:00:22 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:22 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66" returned: 0 in 0.295s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1ecc8-f0c5-4cea-8f5c-bdbca2d06e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967a1eb0-32ec-4000-b3ad-a1cab404c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-520b4dde-79c8-4285-a84f-7f6e5d567498-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:22 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Volume volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 (5442aadf-9021-4ac2-b8a3-6877e3cedb66): created successfully
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967a1eb0-32ec-4000-b3ad-a1cab404c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (ef058214-5de3-4be4-be27-0d9d89316199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-520b4dde-79c8-4285-a84f-7f6e5d567498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:22 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3f10631b-be01-4fa7-b604-eda82c5ed40b tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-520b4dde-79c8-4285-a84f-7f6e5d567498" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-520b4dde-79c8-4285-a84f-7f6e5d567498" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Deleting offline snapshot 520b4dde-79c8-4285-a84f-7f6e5d567498 of volume d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] snapshot_file for this snap is: volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[926fb859-af28-4619-bc1a-c1b9784ef375]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:22 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:22 devstack sudo[109252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498
Sep 25 12:00:22 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:23 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f1f448-840b-4180-9a68-948b0db1ca50]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:23 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d
Sep 25 12:00:23 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 898992da-4a5d-426f-8d31-8c32c55bab36 of volume 5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c4aa5-ce16-458d-b29b-9cabc458bb2d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:23 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" returned: 0 in 0.475s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:23 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:23 devstack sudo[109264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498
Sep 25 12:00:23 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:23 devstack sudo[109263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66
Sep 25 12:00:23 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:24 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66" returned: 0 in 0.411s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:24 devstack sudo[109273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 1G
Sep 25 12:00:24 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:24 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498" returned: 0 in 0.441s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:24 devstack sudo[109275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498
Sep 25 12:00:24 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:24 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d.520b4dde-79c8-4285-a84f-7f6e5d567498" returned: 0 in 0.318s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-520b4dde-79c8-4285-a84f-7f6e5d567498" released by "_delete_snapshot" :: held 1.769s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" released by "delete_snapshot" :: held 1.799s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:24 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 1G" returned: 0 in 0.502s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Created reservations ['a2caf3d4-af24-4305-898e-c8f3b78276b4', 'bf48d784-cf69-42f2-8e65-f09ff6fb392e', 'cad554d7-5ac8-49c8-8a70-157f9b8cb048', '4489c792-93c7-420a-9012-ff034505dfce'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:24 devstack sudo[109281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36
Sep 25 12:00:24 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:24 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Delete snapshot completed successfully.
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-87680acd-b953-45d5-a228-07ad1c18c993 tempest-ProjectReaderTests-258975071 None] Lock "cinder-520b4dde-79c8-4285-a84f-7f6e5d567498-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-d9c6d45c-f3cc-4202-b790-452a3ed9b59d-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:24 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "cinder-d9c6d45c-f3cc-4202-b790-452a3ed9b59d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:25 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:25 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 is being set with open permissions: ugo+rw
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a7fbd-37d1-4666-9ce2-76878b265d77]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:25 devstack sudo[109286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36
Sep 25 12:00:25 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:25 devstack sudo[109287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d
Sep 25 12:00:25 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:25 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36" returned: 0 in 0.324s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:25 devstack sudo[109293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info
Sep 25 12:00:25 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:25 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:25 devstack sudo[109296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d
Sep 25 12:00:25 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:25 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info" returned: 0 in 0.321s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:25 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info is being set with open permissions: ugo+rw
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:25 devstack sudo[109299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info
Sep 25 12:00:25 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:25 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-d9c6d45c-f3cc-4202-b790-452a3ed9b59d" released by "delete_volume" :: held 0.871s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:25 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Created reservations ['af3cdf2b-0490-4d1d-b98d-289cdf76f448', '6f96da99-2042-436e-94e7-1863c3e012f0', '5ebe897e-6139-45bd-80da-b11b42767556', 'f5c78d86-ad6a-4cbb-9e6d-9af1651a53f7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:26 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.info" returned: 0 in 0.329s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:26 devstack sudo[109304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:26 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-193f34f0-0253-4bed-b36b-96632641540f tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 12:00:26 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.319s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:26 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Deleted volume successfully.
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-b89179c3-22ae-4a2f-9c37-ee9b304ace03 tempest-ProjectReaderTests-258975071 None] Lock "cinder-d9c6d45c-f3cc-4202-b790-452a3ed9b59d-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (5e3ad0ce-e6ac-419c-a423-eafb2da91cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138e4f3a-35d4-43fc-947b-90f6af052987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138e4f3a-35d4-43fc-947b-90f6af052987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761379492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ab55c8-8619-4a71-b5bc-1e5b21762b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:27Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996e3d0-7285-4d30-957b-481d2828ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996e3d0-7285-4d30-957b-481d2828ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f94ed75-21a5-42b0-9e99-9c4f6f40092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f94ed75-21a5-42b0-9e99-9c4f6f40092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ab55c8-8619-4a71-b5bc-1e5b21762b1a', 'volume_name': 'volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcd36b9-7c34-49d1-8865-e058bc497725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcd36b9-7c34-49d1-8865-e058bc497725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77ae8d8-c141-40d5-8b46-d6e342c838b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:26 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Volume e6ab55c8-8619-4a71-b5bc-1e5b21762b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a', 'volume_size': 1}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761379492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ab55c8-8619-4a71-b5bc-1e5b21762b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:27Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Creating volume e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:26 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:26 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a 1073741824
Sep 25 12:00:26 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-898992da-4a5d-426f-8d31-8c32c55bab36-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-898992da-4a5d-426f-8d31-8c32c55bab36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-898992da-4a5d-426f-8d31-8c32c55bab36" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-898992da-4a5d-426f-8d31-8c32c55bab36" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:26 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 898992da-4a5d-426f-8d31-8c32c55bab36 of volume 5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8a53f-a8ba-4a22-80cf-66a4818fbf25]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:27 devstack sudo[109309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36
Sep 25 12:00:27 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:27 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a 1073741824" returned: 0 in 0.596s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:27 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36" returned: 0 in 0.482s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:27 devstack sudo[109319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a
Sep 25 12:00:27 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2182e-d8a2-4176-9027-4a5caa00df86]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:27 devstack sudo[109321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66
Sep 25 12:00:27 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:27 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" returned: 0 in 0.308s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77ae8d8-c141-40d5-8b46-d6e342c838b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1ed368-d9dd-4b29-85c3-938bd309db79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:27 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Volume volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a (e6ab55c8-8619-4a71-b5bc-1e5b21762b1a): created successfully
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1ed368-d9dd-4b29-85c3-938bd309db79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (5e3ad0ce-e6ac-419c-a423-eafb2da91cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:27 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a4659757-6ac8-47d5-9496-7f7747dfb43a tempest-ProjectReaderTests-258975071 None] Created volume successfully.
Sep 25 12:00:27 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:27 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:28 devstack sudo[109327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36
Sep 25 12:00:28 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:28 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:28 devstack sudo[109332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36
Sep 25 12:00:28 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:28 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66.898992da-4a5d-426f-8d31-8c32c55bab36" returned: 0 in 0.292s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-898992da-4a5d-426f-8d31-8c32c55bab36" released by "_delete_snapshot" :: held 1.714s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" released by "delete_snapshot" :: held 1.746s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=258,cinder:SELECT=198,cinder:INSERT=66,cinder:DELETE=20 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Created reservations ['3b07d25b-35c3-492a-a1bf-fb2a2a0b6f24', '46fc2c72-6a45-4d94-bb66-825bc545f08b', 'ce6b81e3-58c9-444f-8b32-d2b55afe23a8', '06d5e112-7280-44bb-b779-9fe3abb2a8c7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:28 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 12:00:28 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-d970e001-0597-493a-bccb-1b3d609d8a84 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-898992da-4a5d-426f-8d31-8c32c55bab36-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Creating offline snapshot cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 of volume e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-5442aadf-9021-4ac2-b8a3-6877e3cedb66-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c4a2d-d4d5-4d18-9ca8-5483db202fcf]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-5442aadf-9021-4ac2-b8a3-6877e3cedb66-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:29 devstack sudo[109335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a
Sep 25 12:00:29 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fc0dc-f3ec-40ee-b7ec-71c3f2d9d2bf]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:29 devstack sudo[109337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66
Sep 25 12:00:29 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:29 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" returned: 0 in 0.485s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:29 devstack sudo[109342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 1G
Sep 25 12:00:29 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:29 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:29 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:29 devstack sudo[109347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66
Sep 25 12:00:29 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:30 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 1G" returned: 0 in 0.547s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:30 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-5442aadf-9021-4ac2-b8a3-6877e3cedb66" returned: 0 in 0.375s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:30 devstack sudo[109353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33
Sep 25 12:00:30 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-5442aadf-9021-4ac2-b8a3-6877e3cedb66" released by "delete_volume" :: held 0.960s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Created reservations ['0b9c5ff6-b1f6-4427-a9a4-d474a6bb88aa', '5a23cae8-a6dd-4a0b-814c-f62ec7892d1c', '6db5031f-32dc-4200-ba63-fe863a430027', '1970784b-956b-4fd6-9e98-3e8c19871adc'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:30 devstack sudo[109355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:30 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:30 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:30 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 is being set with open permissions: ugo+rw
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:30 devstack sudo[109360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33
Sep 25 12:00:30 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:30 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.320s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:30 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a9e04ae4-2d92-4206-a8d0-03171ae792c3 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-5442aadf-9021-4ac2-b8a3-6877e3cedb66-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:30 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" returned: 0 in 0.316s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:30 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:30 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info
Sep 25 12:00:30 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:31 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info" returned: 0 in 0.369s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:31 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info is being set with open permissions: ugo+rw
Sep 25 12:00:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:31 devstack sudo[109367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info
Sep 25 12:00:31 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:31 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.info" returned: 0 in 0.327s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:31 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:31 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-61ea7bcc-fc96-4987-8492-b8eddcbee4bf tempest-ProjectReaderTests-258975071 None] Create snapshot completed successfully
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (2cfa8e44-fd2a-473a-8ba0-991730c40d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263c92f5-0b97-4217-aafc-b760f6dbdbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263c92f5-0b97-4217-aafc-b760f6dbdbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733835774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4c4598-e68f-4061-9059-6caeb98a0389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:32Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e167c57-55f4-4077-b996-01308d344245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e167c57-55f4-4077-b996-01308d344245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9857f4e-cd81-44fc-bab4-37cda377b312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9857f4e-cd81-44fc-bab4-37cda377b312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4c4598-e68f-4061-9059-6caeb98a0389', 'volume_name': 'volume-ba4c4598-e68f-4061-9059-6caeb98a0389', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f643d8e5-9fd9-403f-aa98-032da139a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f643d8e5-9fd9-403f-aa98-032da139a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1007e299-75d7-458a-986a-5997a88adaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:32 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Volume ba4c4598-e68f-4061-9059-6caeb98a0389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4c4598-e68f-4061-9059-6caeb98a0389', 'volume_size': 1}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733835774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4c4598-e68f-4061-9059-6caeb98a0389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:32Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Creating volume ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:32 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:32 devstack sudo[109370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 1073741824
Sep 25 12:00:32 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Deleting offline snapshot cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 of volume e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] snapshot_file for this snap is: volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdfb62d-8108-4990-b139-f475b4c1d131]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:32 devstack sudo[109374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33
Sep 25 12:00:32 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:32 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 1073741824" returned: 0 in 0.548s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:32 devstack sudo[109378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389
Sep 25 12:00:32 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:32 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" returned: 0 in 0.452s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf87cf-7b93-407e-921a-4ae9a7e1cc07]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:32 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:33 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389" returned: 0 in 0.293s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:33 devstack sudo[109382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a
Sep 25 12:00:33 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1007e299-75d7-458a-986a-5997a88adaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4c4598-e68f-4061-9059-6caeb98a0389', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74febca-ed00-4a6f-a89a-0a10decf11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:33 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Volume volume-ba4c4598-e68f-4061-9059-6caeb98a0389 (ba4c4598-e68f-4061-9059-6caeb98a0389): created successfully
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74febca-ed00-4a6f-a89a-0a10decf11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (2cfa8e44-fd2a-473a-8ba0-991730c40d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:33 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3f1c30b4-1220-448a-ab83-64c172f95ff8 tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 12:00:33 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" returned: 0 in 0.398s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:33 devstack sudo[109388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33
Sep 25 12:00:33 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:33 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" returned: 0 in 0.340s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:33 devstack sudo[109393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33
Sep 25 12:00:33 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:33 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a.cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" returned: 0 in 0.250s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33" released by "_delete_snapshot" :: held 1.588s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:33 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" released by "delete_snapshot" :: held 1.614s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Created reservations ['ebacb732-d48e-4c56-a668-752a5dc1fd40', '4341940f-761c-49e6-8734-04f36f288c87', '92dcde76-682d-48c0-8560-3c08004ef379', '07ee8cc4-274d-42a7-ba18-3daf88795098'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:34 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Delete snapshot completed successfully.
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-16fe08e9-cd85-46a6-8148-3d3e166769ff tempest-ProjectReaderTests-258975071 None] Lock "cinder-cf7497ec-7fee-4a0e-b7b7-cf1cb2abee33-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 4fb25e3d-015c-4572-bf4e-aecdd380a7b8 of volume ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e44c7-ed55-41d0-bfa8-2ba92df6b55c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:34 devstack sudo[109396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389
Sep 25 12:00:34 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "cinder-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" acquired by "delete_volume" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8060cd77-cad1-43d3-a792-9f4bd7238143]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:34 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389" returned: 0 in 0.422s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:34 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:34 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a
Sep 25 12:00:34 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:34 devstack sudo[109402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 1G
Sep 25 12:00:34 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:35 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" returned: 0 in 0.401s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:35 devstack sudo[109411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a
Sep 25 12:00:35 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:35 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 1G" returned: 0 in 0.431s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4c4598-e68f-4061-9059-6caeb98a0389 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:35 devstack sudo[109413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4c4598-e68f-4061-9059-6caeb98a0389 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8
Sep 25 12:00:35 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:35 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" returned: 0 in 0.274s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a" released by "delete_volume" :: held 0.747s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Created reservations ['b9b19864-0f70-4747-9848-6eead7a1ebeb', 'c96e6986-020e-4b8b-82cc-7168d1728850', '0f4f0bc7-6ff3-4c0e-83ad-814f0fd87736', 'a3d7b233-0167-40bd-977f-fece75c343b2'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:35 devstack sudo[109426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:35 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:35 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4c4598-e68f-4061-9059-6caeb98a0389 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8" returned: 0 in 0.386s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 is being set with open permissions: ugo+rw
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:35 devstack sudo[109428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8
Sep 25 12:00:35 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:35 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.349s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:35 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Deleted volume successfully.
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:35 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-0d2b4c27-64a5-4828-9e06-ebc6f4a687fa tempest-ProjectReaderTests-258975071 None] Lock "cinder-e6ab55c8-8619-4a71-b5bc-1e5b21762b1a-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:35 devstack sudo[109432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info
Sep 25 12:00:35 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:36 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info" returned: 0 in 0.335s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:36 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info is being set with open permissions: ugo+rw
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:36 devstack sudo[109436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info
Sep 25 12:00:36 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (0d62574e-d553-43ae-b923-65e732172374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca10ce2-55a8-4850-867d-4e3fa264f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca10ce2-55a8-4850-867d-4e3fa264f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512491119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f230883-07a0-4273-9a11-af38e2dc1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:36Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2fbd8-07d5-4f17-944e-6c8e47b29c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2fbd8-07d5-4f17-944e-6c8e47b29c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979232bf-ac1c-450b-a55c-9ec6fda2544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979232bf-ac1c-450b-a55c-9ec6fda2544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f230883-07a0-4273-9a11-af38e2dc1894', 'volume_name': 'volume-6f230883-07a0-4273-9a11-af38e2dc1894', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8848d65e-8a11-45e0-8bea-611f5ed76bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8848d65e-8a11-45e0-8bea-611f5ed76bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6060d87-379a-47cb-a046-db054e6c69dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:36 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Volume 6f230883-07a0-4273-9a11-af38e2dc1894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f230883-07a0-4273-9a11-af38e2dc1894', 'volume_size': 1}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:36 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.info" returned: 0 in 0.294s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512491119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f230883-07a0-4273-9a11-af38e2dc1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c278574f51477c853be0b468868875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:36Z,use_quota=True,user_id='532f91208460428f994346b34a38378b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Creating volume 6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:36 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:36 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:36 devstack sudo[109439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 1073741824
Sep 25 12:00:36 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:36 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-05381ec8-3efa-4a76-8d7b-2482aa7a39a5 tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 12:00:37 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 1073741824" returned: 0 in 0.484s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:37 devstack sudo[109445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894
Sep 25 12:00:37 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:37 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894" returned: 0 in 0.341s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6060d87-379a-47cb-a046-db054e6c69dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f230883-07a0-4273-9a11-af38e2dc1894', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5360cf-f8e7-401b-81f5-cabe6a6e69dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:37 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Volume volume-6f230883-07a0-4273-9a11-af38e2dc1894 (6f230883-07a0-4273-9a11-af38e2dc1894): created successfully
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5360cf-f8e7-401b-81f5-cabe6a6e69dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Flow 'volume_create_manager' (0d62574e-d553-43ae-b923-65e732172374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-4fb25e3d-015c-4572-bf4e-aecdd380a7b8-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:37 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-73d099de-48e3-412d-a96f-48cbffc47bf4 tempest-ProjectReaderTests-258975071 None] Created volume successfully.
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-4fb25e3d-015c-4572-bf4e-aecdd380a7b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-4fb25e3d-015c-4572-bf4e-aecdd380a7b8" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-4fb25e3d-015c-4572-bf4e-aecdd380a7b8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 4fb25e3d-015c-4572-bf4e-aecdd380a7b8 of volume ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2319717-60bd-4f41-ad75-d39cabfe1592]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:37 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:37 devstack sudo[109448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8
Sep 25 12:00:37 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:38 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8" returned: 0 in 0.413s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4c4598-e68f-4061-9059-6caeb98a0389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d19606e-55a7-4105-b01a-b9a0ba890373]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:38 devstack sudo[109453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389
Sep 25 12:00:38 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:38 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389" returned: 0 in 0.446s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:38 devstack sudo[109458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8
Sep 25 12:00:38 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=194,cinder:INSERT=82,cinder:UPDATE=258,cinder:DELETE=23 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Creating offline snapshot 60a3d5f5-44ec-4edb-a8f5-c224341bde4a of volume 6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc8cdc-d1d4-4bcc-a356-29091f155fe5]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:38 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894
Sep 25 12:00:38 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:38 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:38 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:38 devstack sudo[109465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8
Sep 25 12:00:38 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:39 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894" returned: 0 in 0.404s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:39 devstack sudo[109470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a 1G
Sep 25 12:00:39 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:39 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389.4fb25e3d-015c-4572-bf4e-aecdd380a7b8" returned: 0 in 0.281s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-4fb25e3d-015c-4572-bf4e-aecdd380a7b8" released by "_delete_snapshot" :: held 1.643s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" released by "delete_snapshot" :: held 1.670s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Created reservations ['1501111d-2da1-49e1-90bc-b34f16b09486', 'f07f1726-ee9a-4eae-a75c-912179e3c90b', 'fb0368cf-0b53-4b86-bacc-dba91ac4e8f4', '84d26166-f5ee-4c82-b109-0a58a929c23d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:39 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-20ea7f7c-270e-4018-b076-3bc941fb754c tempest-ProjectMemberTests-1491797813 None] Lock "cinder-4fb25e3d-015c-4572-bf4e-aecdd380a7b8-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:39 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a 1G" returned: 0 in 0.483s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f230883-07a0-4273-9a11-af38e2dc1894 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:39 devstack sudo[109476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f230883-07a0-4273-9a11-af38e2dc1894 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a
Sep 25 12:00:39 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-ba4c4598-e68f-4061-9059-6caeb98a0389-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ba4c4598-e68f-4061-9059-6caeb98a0389-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[144b2631-d12f-4543-a839-61629391fa05]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:39 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f230883-07a0-4273-9a11-af38e2dc1894 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a" returned: 0 in 0.374s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:39 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a is being set with open permissions: ugo+rw
Sep 25 12:00:39 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:39 devstack sudo[109482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a
Sep 25 12:00:39 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:40 devstack sudo[109481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389
Sep 25 12:00:40 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:40 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:40 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389" returned: 0 in 0.465s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:40 devstack sudo[109490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info
Sep 25 12:00:40 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:40 devstack sudo[109491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389
Sep 25 12:00:40 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:40 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-ba4c4598-e68f-4061-9059-6caeb98a0389" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:40 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info" returned: 0 in 0.342s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:40 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info is being set with open permissions: ugo+rw
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-ba4c4598-e68f-4061-9059-6caeb98a0389" released by "delete_volume" :: held 0.851s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:40 devstack sudo[109496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info
Sep 25 12:00:40 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Created reservations ['6eaa85c2-585c-4ed3-96ed-0fab31e0544a', '70411caa-83ad-4015-b2ef-d5c79fa1b264', 'aaea84d3-9a1c-4d76-a457-871b3229cb13', 'debf7666-a660-4c59-a0eb-d63042e86fd9'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:40 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:40 devstack sudo[109498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:40 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:41 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.info" returned: 0 in 0.323s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-96006086-651a-4337-b455-44cda818e4dd tempest-ProjectReaderTests-258975071 None] Create snapshot completed successfully
Sep 25 12:00:41 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.397s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:41 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-a2bc280d-e324-4016-9448-69fb05b94555 tempest-ProjectMemberTests-1491797813 None] Lock "cinder-ba4c4598-e68f-4061-9059-6caeb98a0389-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (4eebc72f-fc91-4d57-8948-d37d9d25ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167cf7e8-c242-4a8b-a033-56c05613ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167cf7e8-c242-4a8b-a033-56c05613ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216882233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe91230-c693-4ee8-9073-161f4550e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:41Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a75aae-b0ef-4154-86ce-1ca1a7e55367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a75aae-b0ef-4154-86ce-1ca1a7e55367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577906e-792d-4ffc-8b83-44874949aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577906e-792d-4ffc-8b83-44874949aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe91230-c693-4ee8-9073-161f4550e819', 'volume_name': 'volume-afe91230-c693-4ee8-9073-161f4550e819', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e06eae-c7be-414a-a8bf-91cc0b63ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e06eae-c7be-414a-a8bf-91cc0b63ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab43457-17f4-4f4f-98bb-f9ef5ecc47c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:41 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Volume afe91230-c693-4ee8-9073-161f4550e819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe91230-c693-4ee8-9073-161f4550e819', 'volume_size': 1}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216882233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe91230-c693-4ee8-9073-161f4550e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ea5c13f2b441d86001882d465b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:41Z,use_quota=True,user_id='f7e36ab8ebc147419459975559801581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Creating volume afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:41 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:41 devstack sudo[109502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 1073741824
Sep 25 12:00:41 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-60a3d5f5-44ec-4edb-a8f5-c224341bde4a-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-60a3d5f5-44ec-4edb-a8f5-c224341bde4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-60a3d5f5-44ec-4edb-a8f5-c224341bde4a" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-60a3d5f5-44ec-4edb-a8f5-c224341bde4a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Deleting offline snapshot 60a3d5f5-44ec-4edb-a8f5-c224341bde4a of volume 6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] snapshot_file for this snap is: volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa44f4-3d47-494c-a0bb-477e0a467aa3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:41 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:42 devstack sudo[109505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a
Sep 25 12:00:42 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:42 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 1073741824" returned: 0 in 0.555s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:42 devstack sudo[109510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819
Sep 25 12:00:42 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:42 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a" returned: 0 in 0.525s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f230883-07a0-4273-9a11-af38e2dc1894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad85c9e-b712-4739-9492-b9bd941b7b7e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:42 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:42 devstack sudo[109515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894
Sep 25 12:00:42 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab43457-17f4-4f4f-98bb-f9ef5ecc47c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe91230-c693-4ee8-9073-161f4550e819', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c2ba5a-5577-49d9-b424-645ac81e502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:42 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Volume volume-afe91230-c693-4ee8-9073-161f4550e819 (afe91230-c693-4ee8-9073-161f4550e819): created successfully
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c2ba5a-5577-49d9-b424-645ac81e502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Flow 'volume_create_manager' (4eebc72f-fc91-4d57-8948-d37d9d25ce70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:42 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-79c87ac7-7470-4940-84e7-0c9b173b140d tempest-ProjectMemberTests-1491797813 None] Created volume successfully.
Sep 25 12:00:42 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894" returned: 0 in 0.434s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:42 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:42 devstack sudo[109522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a
Sep 25 12:00:42 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:43 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:43 devstack sudo[109528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a
Sep 25 12:00:43 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:43 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894.60a3d5f5-44ec-4edb-a8f5-c224341bde4a" returned: 0 in 0.267s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-60a3d5f5-44ec-4edb-a8f5-c224341bde4a" released by "_delete_snapshot" :: held 1.753s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" released by "delete_snapshot" :: held 1.779s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Created reservations ['b543fa2b-d57d-4b70-91a4-a7debe58fcb7', '6c36ea5b-5d46-4983-94db-ac4ae100731c', 'e4e4ca0f-db20-4958-9969-3f0335b2be5a', '68f7b86d-746b-465e-9677-25caffb63a8c'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:43 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Delete snapshot completed successfully.
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96a5a876-0e41-4216-8d04-9b5e9299a52b tempest-ProjectReaderTests-258975071 None] Lock "cinder-60a3d5f5-44ec-4edb-a8f5-c224341bde4a-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Creating offline snapshot 61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 of volume afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c1f1f4-1b5f-4426-91ea-bf8269dae8d8]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:43 devstack sudo[109531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819
Sep 25 12:00:43 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:43 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-6f230883-07a0-4273-9a11-af38e2dc1894-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "cinder-6f230883-07a0-4273-9a11-af38e2dc1894-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Acquiring lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3805b2-e0ad-4efa-a873-d63b588fbca1]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:44 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819" returned: 0 in 0.409s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:44 devstack sudo[109537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 1G
Sep 25 12:00:44 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:44 devstack sudo[109535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894
Sep 25 12:00:44 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:44 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894" returned: 0 in 0.482s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:44 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894
Sep 25 12:00:44 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:44 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 1G" returned: 0 in 0.459s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe91230-c693-4ee8-9073-161f4550e819 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:44 devstack sudo[109548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe91230-c693-4ee8-9073-161f4550e819 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3
Sep 25 12:00:44 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:44 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6f230883-07a0-4273-9a11-af38e2dc1894" returned: 0 in 0.304s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:44 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "cinder-quobyte-6f230883-07a0-4273-9a11-af38e2dc1894" released by "delete_volume" :: held 0.877s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Created reservations ['466b5f25-047a-4469-80e5-ce01f97fd759', '70254e60-8430-4d43-bf7c-0a0161e4ff1c', '305fa711-91d4-412e-b1c0-7bb773b5d0c1', '5ade2528-cf6f-4d0f-82d7-9eb21f51273d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:45 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe91230-c693-4ee8-9073-161f4550e819 -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" returned: 0 in 0.357s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:45 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 is being set with open permissions: ugo+rw
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:45 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3
Sep 25 12:00:45 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:45 devstack sudo[109556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:45 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:45 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" returned: 0 in 0.310s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:45 devstack sudo[109560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info
Sep 25 12:00:45 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:45 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.309s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:45 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Deleted volume successfully.
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f19ad9f5-6052-464c-963e-3169ea4733ea tempest-ProjectReaderTests-258975071 None] Lock "cinder-6f230883-07a0-4273-9a11-af38e2dc1894-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:45 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info" returned: 0 in 0.292s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:45 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info is being set with open permissions: ugo+rw
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:45 devstack sudo[109563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info
Sep 25 12:00:45 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:45 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:45 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.info" returned: 0 in 0.273s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:46 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:46 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f125d1a3-15c4-495c-b393-ceb6e92bde0b tempest-ProjectMemberTests-1491797813 None] Create snapshot completed successfully
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Deleting offline snapshot 61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 of volume afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] snapshot_file for this snap is: volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d1c66-20f3-4788-9365-e6a4b8149d10]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:47 devstack sudo[109567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3
Sep 25 12:00:47 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:47 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" returned: 0 in 0.444s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe91230-c693-4ee8-9073-161f4550e819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c85572-76f6-41d7-8e80-4e4fb6c1f121]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:47 devstack sudo[109572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819
Sep 25 12:00:47 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:48 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819" returned: 0 in 0.465s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:48 devstack sudo[109577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3
Sep 25 12:00:48 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:48 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" returned: 0 in 0.381s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:48 devstack sudo[109583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3
Sep 25 12:00:48 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:48 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819.61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" returned: 0 in 0.302s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3" released by "_delete_snapshot" :: held 1.754s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:48 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" released by "delete_snapshot" :: held 1.782s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Created reservations ['dc4af0b7-9822-45be-81cb-119c2b9ecb00', '0b1c5c4c-4385-473d-bf58-8186040307e1', '7d50cad7-a3ba-4731-8320-5b5869849c27', 'b4257b08-8f53-4872-9fd8-1a10b9306b2b'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:49 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Delete snapshot completed successfully.
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-77fc6261-3c88-41e2-8f15-9d452488ec5d tempest-ProjectMemberTests-1491797813 None] Lock "cinder-61c612fd-2d3a-45d8-a7c9-e8398aa8e7b3-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-afe91230-c693-4ee8-9073-161f4550e819-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-afe91230-c693-4ee8-9073-161f4550e819-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1d168-0709-4341-b9a3-b6ffd8ea981d]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:49 devstack sudo[109587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819
Sep 25 12:00:49 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:49 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819" returned: 0 in 0.458s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:49 devstack sudo[109593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819
Sep 25 12:00:49 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:50 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-afe91230-c693-4ee8-9073-161f4550e819" returned: 0 in 0.302s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-quobyte-afe91230-c693-4ee8-9073-161f4550e819" released by "delete_volume" :: held 0.854s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Created reservations ['9576074f-d39b-41cf-bdb4-a9fac4951cba', '86c083bc-ee4f-4cca-b73d-6cb06322d260', '9bb91169-b260-43c1-a185-38ed927bef49', 'f64b2fba-a001-4291-8596-591ceaeb97d8'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:50 devstack sudo[109596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:50 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:50 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.288s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Deleted volume successfully.
Sep 25 12:00:50 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-5769858a-b2fb-4ce6-8d0c-53713275639f tempest-ProjectMemberTests-1491797813 None] Lock "cinder-afe91230-c693-4ee8-9073-161f4550e819-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:51 devstack sudo[109599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:00:51 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:51 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.318s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 12:00:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (c3f769c6-b83c-4fc5-979a-b841755d8d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868943a2-ef24-484c-89de-b2d649e2a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868943a2-ef24-484c-89de-b2d649e2a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221890507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e77a74f-e02d-44e3-9339-53042f374ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:58Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc0ff59-6046-42ac-bccc-cbe9be5a5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc0ff59-6046-42ac-bccc-cbe9be5a5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca561801-305b-460d-a790-63da37168ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca561801-305b-460d-a790-63da37168ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e77a74f-e02d-44e3-9339-53042f374ec7', 'volume_name': 'volume-6e77a74f-e02d-44e3-9339-53042f374ec7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f413266-21be-418e-abfa-d39117142013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f413266-21be-418e-abfa-d39117142013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fcb294-a686-4a56-96de-025d9946be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Volume 6e77a74f-e02d-44e3-9339-53042f374ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e77a74f-e02d-44e3-9339-53042f374ec7', 'volume_size': 1}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221890507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e77a74f-e02d-44e3-9339-53042f374ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:58Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Creating volume 6e77a74f-e02d-44e3-9339-53042f374ec7 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:00:58 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:58 devstack sudo[109641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 1073741824
Sep 25 12:00:58 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:58 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 1073741824" returned: 0 in 0.442s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:58 devstack sudo[109647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7
Sep 25 12:00:58 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:59 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7" returned: 0 in 0.283s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fcb294-a686-4a56-96de-025d9946be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e77a74f-e02d-44e3-9339-53042f374ec7', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76343e32-69b6-4396-9818-904da0f0a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:00:59 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Volume volume-6e77a74f-e02d-44e3-9339-53042f374ec7 (6e77a74f-e02d-44e3-9339-53042f374ec7): created successfully
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76343e32-69b6-4396-9818-904da0f0a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (c3f769c6-b83c-4fc5-979a-b841755d8d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:00:59 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-12ef16a3-ee62-4e23-a00e-f22cfb29df09 tempest-ProjectReaderTests-1351334142 None] Created volume successfully.
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-6e77a74f-e02d-44e3-9339-53042f374ec7-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "cinder-6e77a74f-e02d-44e3-9339-53042f374ec7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-quobyte-6e77a74f-e02d-44e3-9339-53042f374ec7" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-6e77a74f-e02d-44e3-9339-53042f374ec7" acquired by "delete_volume" :: waited 0.025s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[14037d89-dae9-4c1d-b82c-62c6a05bd1d6]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:59 devstack sudo[109650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7
Sep 25 12:00:59 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:00:59 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7" returned: 0 in 0.360s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:00:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:00:59 devstack sudo[109655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7
Sep 25 12:00:59 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:00 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-6e77a74f-e02d-44e3-9339-53042f374ec7" returned: 0 in 0.248s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-6e77a74f-e02d-44e3-9339-53042f374ec7" released by "delete_volume" :: held 0.669s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Created reservations ['6d940a06-2b17-481b-bc5f-f39fc0298bd7', 'f5d43bf0-ffdb-4dd7-86fb-b447becc1830', '96406928-0b4b-411a-9744-282b03ff4e5d', '28c32975-975c-4b11-bbdf-0025e47e71a4'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:00 devstack sudo[109658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:00 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:00 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.288s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Deleted volume successfully.
Sep 25 12:01:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-46c93620-8266-41b8-8784-534c8c7156fe tempest-ProjectReaderTests-1351334142 None] Lock "cinder-6e77a74f-e02d-44e3-9339-53042f374ec7-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (552f68b2-1110-4d41-9792-b551bcf000db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49121542-fa52-4ec4-8f42-ce40dc7ac160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49121542-fa52-4ec4-8f42-ce40dc7ac160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805943407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0929e897-94ae-4f17-9ce1-bc6adb08066f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:01Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658bc0a-a586-4f4b-80ea-62673f304e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658bc0a-a586-4f4b-80ea-62673f304e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fd9080-77e3-48b1-af96-4b95c6554b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fd9080-77e3-48b1-af96-4b95c6554b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0929e897-94ae-4f17-9ce1-bc6adb08066f', 'volume_name': 'volume-0929e897-94ae-4f17-9ce1-bc6adb08066f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def3654d-12dd-4270-b11f-3c2dd670ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def3654d-12dd-4270-b11f-3c2dd670ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24e9072-12f1-46b7-9ad0-2b6b1357360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:01 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Volume 0929e897-94ae-4f17-9ce1-bc6adb08066f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0929e897-94ae-4f17-9ce1-bc6adb08066f', 'volume_size': 1}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805943407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0929e897-94ae-4f17-9ce1-bc6adb08066f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:01Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Creating volume 0929e897-94ae-4f17-9ce1-bc6adb08066f {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:01 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:01 devstack sudo[109661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f 1073741824
Sep 25 12:01:01 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:01 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f 1073741824" returned: 0 in 0.454s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:01 devstack sudo[109667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f
Sep 25 12:01:01 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:02 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f" returned: 0 in 0.259s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24e9072-12f1-46b7-9ad0-2b6b1357360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0929e897-94ae-4f17-9ce1-bc6adb08066f', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7efa375-f100-47c5-a96c-56e238c369dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:02 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Volume volume-0929e897-94ae-4f17-9ce1-bc6adb08066f (0929e897-94ae-4f17-9ce1-bc6adb08066f): created successfully
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7efa375-f100-47c5-a96c-56e238c369dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:02 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (552f68b2-1110-4d41-9792-b551bcf000db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-17aaaf26-1abd-4156-a242-5ae6a69047ef tempest-ProjectReaderTests-1351334142 None] Created volume successfully.
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-0929e897-94ae-4f17-9ce1-bc6adb08066f-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "cinder-0929e897-94ae-4f17-9ce1-bc6adb08066f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-quobyte-0929e897-94ae-4f17-9ce1-bc6adb08066f" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-0929e897-94ae-4f17-9ce1-bc6adb08066f" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a980c-b37e-413b-9776-a4324fd8e8c3]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:03 devstack sudo[109670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f
Sep 25 12:01:03 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:03 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f" returned: 0 in 0.423s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:03 devstack sudo[109676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f
Sep 25 12:01:03 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:04 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-0929e897-94ae-4f17-9ce1-bc6adb08066f" returned: 0 in 0.291s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-0929e897-94ae-4f17-9ce1-bc6adb08066f" released by "delete_volume" :: held 0.760s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Created reservations ['85893f61-c5f1-4b01-8fff-01efa7de66a1', '552c5d4c-2439-4a7c-9de0-4ce195ef4991', '1d7c11af-13b6-4322-bd89-e29ca1e05eff', '1ef1ccd4-6063-4241-8c24-7043f406f4fe'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:04 devstack sudo[109679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:04 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:04 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.260s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:04 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Deleted volume successfully.
Sep 25 12:01:04 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-6d64cb91-1ba1-4158-af27-b5b18b23853d tempest-ProjectReaderTests-1351334142 None] Lock "cinder-0929e897-94ae-4f17-9ce1-bc6adb08066f-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (b1cf7252-d794-4b31-a414-51713a26bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d11290-aac6-4205-8564-3e0545f0fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d11290-aac6-4205-8564-3e0545f0fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913797712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4398951-6fa1-4dbe-a0b3-dd417d649b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:05Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb23841-de19-4d23-ac9f-c21903ce60d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb23841-de19-4d23-ac9f-c21903ce60d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60e7eb9-fe4d-4d11-9c9f-e145f827899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60e7eb9-fe4d-4d11-9c9f-e145f827899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4398951-6fa1-4dbe-a0b3-dd417d649b48', 'volume_name': 'volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249fc2ef-7f3a-4b93-91bd-81897b04fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249fc2ef-7f3a-4b93-91bd-81897b04fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40e39a0-4062-4009-adb8-f7983499c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Volume d4398951-6fa1-4dbe-a0b3-dd417d649b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48', 'volume_size': 1}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913797712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4398951-6fa1-4dbe-a0b3-dd417d649b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:05Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Creating volume d4398951-6fa1-4dbe-a0b3-dd417d649b48 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:05 devstack sudo[109682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 1073741824
Sep 25 12:01:05 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Flow 'volume_create_manager' (ecc1a475-5e9c-4d92-8e75-4869a71d1fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fa6a6c-1d74-4611-9f42-d3d6e1caf825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fa6a6c-1d74-4611-9f42-d3d6e1caf825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98593353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a63f1b-c2d3-4066-a4aa-9bfc50058575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f75fbf27fad4d8ca78d70edf1b1d961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:05Z,use_quota=True,user_id='03f5d30252984c51ad1bf9c62516535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e9f2ae-dec0-4d57-abd4-1f3ebacb1c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e9f2ae-dec0-4d57-abd4-1f3ebacb1c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ea3b3a-eb61-4901-8855-343dcbaca37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ea3b3a-eb61-4901-8855-343dcbaca37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a63f1b-c2d3-4066-a4aa-9bfc50058575', 'volume_name': 'volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3b9cd0-25df-496a-9bab-90dba02769e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3b9cd0-25df-496a-9bab-90dba02769e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a68ae8-5ce5-44cd-8de7-227c90b81a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Volume e5a63f1b-c2d3-4066-a4aa-9bfc50058575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575', 'volume_size': 1}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:05 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 1073741824" returned: 0 in 0.464s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:05 devstack sudo[109687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48
Sep 25 12:01:05 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:05 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48" returned: 0 in 0.236s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98593353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a63f1b-c2d3-4066-a4aa-9bfc50058575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f75fbf27fad4d8ca78d70edf1b1d961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:05Z,use_quota=True,user_id='03f5d30252984c51ad1bf9c62516535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Creating volume e5a63f1b-c2d3-4066-a4aa-9bfc50058575 {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40e39a0-4062-4009-adb8-f7983499c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 1073741824
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e271075f-2c87-4695-8d59-fe4fbe2b7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:05 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Volume volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 (d4398951-6fa1-4dbe-a0b3-dd417d649b48): created successfully
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e271075f-2c87-4695-8d59-fe4fbe2b7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:05 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (b1cf7252-d794-4b31-a414-51713a26bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:05 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-d914bbd7-018a-43c5-aea8-adbcdbc363c5 tempest-ProjectReaderTests-1351334142 None] Created volume successfully.
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-d4398951-6fa1-4dbe-a0b3-dd417d649b48-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-d4398951-6fa1-4dbe-a0b3-dd417d649b48-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-quobyte-d4398951-6fa1-4dbe-a0b3-dd417d649b48" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-d4398951-6fa1-4dbe-a0b3-dd417d649b48" acquired by "delete_volume" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadc244b-9add-43e4-8969-57931644bbca]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:06 devstack sudo[109696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48
Sep 25 12:01:06 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:06 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 1073741824" returned: 0 in 0.500s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:06 devstack sudo[109699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575
Sep 25 12:01:06 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:06 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48" returned: 0 in 0.380s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:06 devstack sudo[109705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48
Sep 25 12:01:06 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:06 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" returned: 0 in 0.261s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a68ae8-5ce5-44cd-8de7-227c90b81a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cada61-c21e-4074-9a8f-85082366cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:06 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Volume volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 (e5a63f1b-c2d3-4066-a4aa-9bfc50058575): created successfully
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cada61-c21e-4074-9a8f-85082366cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Flow 'volume_create_manager' (ecc1a475-5e9c-4d92-8e75-4869a71d1fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:06 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-9c2194a9-beb0-40c7-9046-c5a51fb1328c tempest-ProjectReaderTests-546088469 None] Created volume successfully.
Sep 25 12:01:06 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-d4398951-6fa1-4dbe-a0b3-dd417d649b48" returned: 0 in 0.265s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-d4398951-6fa1-4dbe-a0b3-dd417d649b48" released by "delete_volume" :: held 0.686s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Created reservations ['acb1811c-e15b-4d1c-8eac-72a04beaba80', 'eb3e25bb-6f23-451d-966b-a964658e31ea', '1840da12-c759-4668-ac68-61126f24cae0', '4715d0c2-a33c-4935-b1dc-0b2fbc74983f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:06 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:07 devstack sudo[109709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:07 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:07 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.265s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:07 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Deleted volume successfully.
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-bcf3843b-9baf-4269-a173-f17060c08e31 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-d4398951-6fa1-4dbe-a0b3-dd417d649b48-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Acquiring lock "cinder-e5a63f1b-c2d3-4066-a4aa-9bfc50058575-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "cinder-e5a63f1b-c2d3-4066-a4aa-9bfc50058575-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Acquiring lock "cinder-quobyte-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "cinder-quobyte-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (24a7d8c4-75a8-4410-a37f-49e2cbb6cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbe2f3f-d51b-4470-8352-b76c4cdf0c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[392f3ad6-c39f-4880-8b7e-220d232c977c]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbe2f3f-d51b-4470-8352-b76c4cdf0c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371231497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ca4e8c-b680-43f1-a15b-71666ccf83ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:08Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5c072f-bbb0-4cea-bcc7-22aa1475098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5c072f-bbb0-4cea-bcc7-22aa1475098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545d51d7-7b24-4661-a852-65f639bf13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545d51d7-7b24-4661-a852-65f639bf13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ca4e8c-b680-43f1-a15b-71666ccf83ec', 'volume_name': 'volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8bc63b-e416-4676-822f-5fe2351f1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8bc63b-e416-4676-822f-5fe2351f1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f353716-39fc-46d2-9f33-3f7a31c7b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:07 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Volume 13ca4e8c-b680-43f1-a15b-71666ccf83ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec', 'volume_size': 1}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371231497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ca4e8c-b680-43f1-a15b-71666ccf83ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8351a41361e94851989fc48f1224c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:08Z,use_quota=True,user_id='b327a9d4131f44448183c582c320c799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Creating volume 13ca4e8c-b680-43f1-a15b-71666ccf83ec {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:07 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:07 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:07 devstack sudo[109713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec 1073741824
Sep 25 12:01:07 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:07 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575
Sep 25 12:01:07 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:08 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" returned: 0 in 0.389s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:08 devstack sudo[109722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575
Sep 25 12:01:08 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:08 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec 1073741824" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:08 devstack sudo[109724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec
Sep 25 12:01:08 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:08 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" returned: 0 in 0.282s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "cinder-quobyte-e5a63f1b-c2d3-4066-a4aa-9bfc50058575" released by "delete_volume" :: held 0.745s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Created reservations ['d119a737-56e6-46e1-a068-5edbd63f220e', '1c44ba2e-791d-46ed-9ae9-51e24787313c', 'dbacb785-f512-49d0-896c-457c41863893', '4bdddf1c-3e81-4ed1-a8a3-495071a36c24'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:08 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec" returned: 0 in 0.274s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:08 devstack sudo[109728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:08 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f353716-39fc-46d2-9f33-3f7a31c7b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af020028-6b10-4d6b-8017-193cb38c2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:08 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Volume volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec (13ca4e8c-b680-43f1-a15b-71666ccf83ec): created successfully
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af020028-6b10-4d6b-8017-193cb38c2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Flow 'volume_create_manager' (24a7d8c4-75a8-4410-a37f-49e2cbb6cb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f220c290-2c13-46a7-b05c-7bd18ae660c0 tempest-ProjectReaderTests-1351334142 None] Created volume successfully.
Sep 25 12:01:08 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.251s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:08 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Deleted volume successfully.
Sep 25 12:01:08 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-c9c3a4e3-8d12-4d55-864d-36851405b27e tempest-ProjectReaderTests-546088469 None] Lock "cinder-e5a63f1b-c2d3-4066-a4aa-9bfc50058575-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Flow 'volume_create_manager' (a6eab524-f781-4ee1-9694-e88bd8ac47a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1a8aa-ec7e-4459-8c42-fb04bf3aebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1a8aa-ec7e-4459-8c42-fb04bf3aebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408108149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6ada99-502e-4b9e-b89b-5279c093315b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f75fbf27fad4d8ca78d70edf1b1d961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:09Z,use_quota=True,user_id='03f5d30252984c51ad1bf9c62516535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c480f6-0628-430a-ab2b-59c49f678170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c480f6-0628-430a-ab2b-59c49f678170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea9b74a-71fa-4fea-97ca-0bc030e0e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea9b74a-71fa-4fea-97ca-0bc030e0e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6ada99-502e-4b9e-b89b-5279c093315b', 'volume_name': 'volume-4d6ada99-502e-4b9e-b89b-5279c093315b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8dea1bd-0934-4ab5-9870-0056cf3f7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8dea1bd-0934-4ab5-9870-0056cf3f7a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6395785-3b18-41c7-9537-afd9008aaabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:09 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Volume 4d6ada99-502e-4b9e-b89b-5279c093315b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6ada99-502e-4b9e-b89b-5279c093315b', 'volume_size': 1}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408108149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6ada99-502e-4b9e-b89b-5279c093315b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f75fbf27fad4d8ca78d70edf1b1d961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:09Z,use_quota=True,user_id='03f5d30252984c51ad1bf9c62516535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Creating volume 4d6ada99-502e-4b9e-b89b-5279c093315b {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:09 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:09 devstack sudo[109731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b 1073741824
Sep 25 12:01:09 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:09 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b 1073741824" returned: 0 in 0.504s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:09 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-13ca4e8c-b680-43f1-a15b-71666ccf83ec-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-13ca4e8c-b680-43f1-a15b-71666ccf83ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:10 devstack sudo[109737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "cinder-quobyte-13ca4e8c-b680-43f1-a15b-71666ccf83ec" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:10 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-13ca4e8c-b680-43f1-a15b-71666ccf83ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc902c2b-2f62-48f0-a311-89ad93ca5066]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:10 devstack sudo[109739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec
Sep 25 12:01:10 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:10 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b" returned: 0 in 0.286s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6395785-3b18-41c7-9537-afd9008aaabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6ada99-502e-4b9e-b89b-5279c093315b', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02be6730-0432-44e1-8da6-8cc1f6766189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:10 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Volume volume-4d6ada99-502e-4b9e-b89b-5279c093315b (4d6ada99-502e-4b9e-b89b-5279c093315b): created successfully
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02be6730-0432-44e1-8da6-8cc1f6766189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Flow 'volume_create_manager' (a6eab524-f781-4ee1-9694-e88bd8ac47a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:10 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-66ae0fe0-5824-4728-8205-d729df160afc tempest-ProjectReaderTests-546088469 None] Created volume successfully.
Sep 25 12:01:10 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec" returned: 0 in 0.417s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:10 devstack sudo[109745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec
Sep 25 12:01:10 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:10 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-13ca4e8c-b680-43f1-a15b-71666ccf83ec" returned: 0 in 0.242s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-quobyte-13ca4e8c-b680-43f1-a15b-71666ccf83ec" released by "delete_volume" :: held 0.706s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Created reservations ['ed637be6-6c1d-4a61-b272-436a5aa278ec', '4c17cfc1-3187-4498-8186-f183e712de89', 'd2e1b59b-72f8-4706-9c1d-e03185505b2f', 'dc1630ef-fad4-45af-916c-abfdcd41e21d'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:10 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:10 devstack sudo[109748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:10 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:11 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.277s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:11 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Deleted volume successfully.
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-47820742-0315-4def-9802-ccf052ce7f10 tempest-ProjectReaderTests-1351334142 None] Lock "cinder-13ca4e8c-b680-43f1-a15b-71666ccf83ec-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Acquiring lock "cinder-4d6ada99-502e-4b9e-b89b-5279c093315b-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "cinder-4d6ada99-502e-4b9e-b89b-5279c093315b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Acquiring lock "cinder-quobyte-4d6ada99-502e-4b9e-b89b-5279c093315b" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "cinder-quobyte-4d6ada99-502e-4b9e-b89b-5279c093315b" acquired by "delete_volume" :: waited 0.023s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[298abe5b-3bdf-46fb-aa9b-5299b9928b57]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:11 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:11 devstack sudo[109751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b
Sep 25 12:01:11 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:12 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b" returned: 0 in 0.410s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:12 devstack sudo[109756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b
Sep 25 12:01:12 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:12 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-4d6ada99-502e-4b9e-b89b-5279c093315b" returned: 0 in 0.307s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "cinder-quobyte-4d6ada99-502e-4b9e-b89b-5279c093315b" released by "delete_volume" :: held 0.774s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Created reservations ['59a1766d-8559-480f-a445-c361386c3544', '29602b3e-b49f-4e97-b432-acb1891013a6', '11450f48-3af4-4503-aaa3-510d473799c3', '35a39d58-69cd-45f9-a222-08b414b44da7'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:12 devstack sudo[109759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:12 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:12 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.310s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:12 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Deleted volume successfully.
Sep 25 12:01:12 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-851c332a-bad2-4ee7-8509-2efe3a27ed0e tempest-ProjectReaderTests-546088469 None] Lock "cinder-4d6ada99-502e-4b9e-b89b-5279c093315b-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:22 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=109,cinder:INSERT=36,cinder:UPDATE=154,cinder:DELETE=9 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 12:01:22 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=72,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=11 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Flow 'volume_create_manager' (606eea95-b37a-459e-9b0d-4fc5f86a943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a74f1c-cd89-4def-97ae-6d1ed653bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a74f1c-cd89-4def-97ae-6d1ed653bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1809611207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944fc063-ef83-4372-a0cc-c612806909ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cf084934954520ab1f1d7a0036f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:47Z,use_quota=True,user_id='508e9074b785444ab05a1d2670ec20d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04917916-829e-4e9b-b239-7e79f798eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04917916-829e-4e9b-b239-7e79f798eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a1e84e-82b7-4e6c-9648-2b58677d1b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a1e84e-82b7-4e6c-9648-2b58677d1b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944fc063-ef83-4372-a0cc-c612806909ef', 'volume_name': 'volume-944fc063-ef83-4372-a0cc-c612806909ef', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c688e2cc-e749-44f3-949a-080c4e6c84ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c688e2cc-e749-44f3-949a-080c4e6c84ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc8b614-87c9-4014-aaac-6a1b0838103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Volume 944fc063-ef83-4372-a0cc-c612806909ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944fc063-ef83-4372-a0cc-c612806909ef', 'volume_size': 1}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79d8d6da9700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1809611207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944fc063-ef83-4372-a0cc-c612806909ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cf084934954520ab1f1d7a0036f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:47Z,use_quota=True,user_id='508e9074b785444ab05a1d2670ec20d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)}" {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Creating volume 944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:47 devstack cinder-volume[87358]: INFO cinder.volume.drivers.remotefs [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] casted to osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef 1073741824 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:47 devstack sudo[109777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef 1073741824
Sep 25 12:01:47 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:47 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef 1073741824" returned: 0 in 0.448s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:47 devstack sudo[109782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:01:47 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:47 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.245s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'} {{(pid=87358) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc8b614-87c9-4014-aaac-6a1b0838103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944fc063-ef83-4372-a0cc-c612806909ef', 'volume_size': 1}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879db9b7-5fff-4a38-b80c-47a7c9b601a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:47 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Volume volume-944fc063-ef83-4372-a0cc-c612806909ef (944fc063-ef83-4372-a0cc-c612806909ef): created successfully
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879db9b7-5fff-4a38-b80c-47a7c9b601a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:47 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Flow 'volume_create_manager' (606eea95-b37a-459e-9b0d-4fc5f86a943b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:47 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-89e40280-027a-4b82-a143-e8d1df4d9480 tempest-SnapshotDependencyTests-604406127 None] Created volume successfully.
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Creating offline snapshot 5e0019de-80b4-452b-8a96-8cfcb948dd05 of volume 944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63d620-4775-484d-a7ab-9a43331227c2]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:48 devstack sudo[109785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:01:48 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:48 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.378s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:48 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 1G {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:48 devstack sudo[109790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 1G
Sep 25 12:01:48 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:49 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 1G" returned: 0 in 0.396s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944fc063-ef83-4372-a0cc-c612806909ef -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:49 devstack sudo[109795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944fc063-ef83-4372-a0cc-c612806909ef -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:01:49 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:49 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944fc063-ef83-4372-a0cc-c612806909ef -F qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.293s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:49 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 is being set with open permissions: ugo+rw
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:49 devstack sudo[109800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:01:49 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:49 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:49 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:49 devstack sudo[109804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info
Sep 25 12:01:49 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:50 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info" returned: 0 in 0.278s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:50 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info is being set with open permissions: ugo+rw
Sep 25 12:01:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:50 devstack sudo[109807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info
Sep 25 12:01:50 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:50 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.info" returned: 0 in 0.281s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:50 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:50 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-3de3b4b0-71d9-4b86-be5a-b4e4d3619cbe tempest-SnapshotDependencyTests-604406127 None] Create snapshot completed successfully
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87358) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Flow 'volume_create_manager' (2bae1c42-2acc-4c73-b77e-e8573ed91c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac44a8-74ad-4a23-af4c-78da1de43ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac44a8-74ad-4a23-af4c-78da1de43ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T10:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15d728a-6867-4df5-9b8e-dc0bab8b09e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cf084934954520ab1f1d7a0036f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e0019de-80b4-452b-8a96-8cfcb948dd05,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:51Z,use_quota=True,user_id='508e9074b785444ab05a1d2670ec20d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a59e3d-1c99-4f75-8bf1-406ac83de3b3),volume_type_id=c7a59e3d-1c99-4f75-8bf1-406ac83de3b3)' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0b951f-9979-4083-9e2d-ab5fd2464c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0b951f-9979-4083-9e2d-ab5fd2464c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89a702a-4cb0-45e5-a5d6-c7a920ddf56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89a702a-4cb0-45e5-a5d6-c7a920ddf56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f15d728a-6867-4df5-9b8e-dc0bab8b09e9', 'volume_name': 'volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9', 'volume_size': 1, 'snapshot_id': '5e0019de-80b4-452b-8a96-8cfcb948dd05'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787ba8b3-d93d-4e38-86a5-bc19eca581d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787ba8b3-d93d-4e38-86a5-bc19eca581d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95657607-a445-45e1-959e-6756696b0d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:51 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Volume f15d728a-6867-4df5-9b8e-dc0bab8b09e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9', 'volume_size': 1, 'snapshot_id': '5e0019de-80b4-452b-8a96-8cfcb948dd05'}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" by "_create_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Creating volume f15d728a-6867-4df5-9b8e-dc0bab8b09e9 from snapshot 5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Selected osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2 as target Quobyte volume. {{(pid=87358) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" by "_copy_volume_from_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] snapshot: 5e0019de-80b4-452b-8a96-8cfcb948dd05, volume: f15d728a-6867-4df5-9b8e-dc0bab8b09e9,  {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9bca77-d7f8-433b-a0e6-e2a68036bd9f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:51 devstack sudo[109810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:01:51 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:51 devstack sudo[109814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:01:51 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:51 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.411s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944fc063-ef83-4372-a0cc-c612806909ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4555612-a8aa-42f6-b686-cc9040cbe32e]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:51 devstack sudo[109817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:01:51 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:51 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.271s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG oslo_service.periodic_task [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] Running periodic task VolumeManager._thread_info {{(pid=87358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread count: 28 {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 12:01:51 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-22bdf1a2-9bd9-4f27-a2db-dcad77aeae7e None None] thread info: [<_MainThread(MainThread, started 133972338462848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133972225060800)>, <Thread(Thread-3 (stat_writer), started daemon 133972223422144)>, <Thread(Rabbit-heartbeat, started daemon 133972225148736)>, <Thread(Thread-5 (_runner), started daemon 133972222227328)>, <Thread(Thread-7 (_runner), started daemon 133972222311104)>, <Thread(fd_logger, started daemon 133972218243584)>, <Thread(privsep_reader, started daemon 133972221350080)>, <Thread(tpool_thread_0, started daemon 133972212647616)>, <Thread(tpool_thread_1, started daemon 133972204254912)>, <Thread(tpool_thread_2, started daemon 133972195845824)>, <Thread(tpool_thread_3, started daemon 133972187436736)>, <Thread(tpool_thread_4, started daemon 133972179027648)>, <Thread(tpool_thread_5, started daemon 133972170618560)>, <Thread(tpool_thread_6, started daemon 133972162209472)>, <Thread(tpool_thread_7, started daemon 133972153800384)>, <Thread(tpool_thread_8, started daemon 133972145391296)>, <Thread(tpool_thread_9, started daemon 133972136982208)>, <Thread(tpool_thread_10, started daemon 133972128573120)>, <Thread(tpool_thread_11, started daemon 133972120164032)>, <Thread(tpool_thread_12, started daemon 133972111754944)>, <Thread(tpool_thread_13, started daemon 133972103345856)>, <Thread(tpool_thread_14, started daemon 133972094936768)>, <Thread(tpool_thread_15, started daemon 133972086527680)>, <Thread(tpool_thread_16, started daemon 133972078118592)>, <Thread(tpool_thread_17, started daemon 133972069709504)>, <Thread(tpool_thread_18, started daemon 133972061300416)>, <Thread(tpool_thread_19, started daemon 133972052891328)>] {{(pid=87358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 12:01:52 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.394s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 12:01:52 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Creating direct copy from snapshot {{(pid=87358) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 12:01:52 devstack cinder-volume[87358]: DEBUG cinder.utils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Path /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 not found in is_blk_device check {{(pid=87358) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 12:01:52 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:52 devstack sudo[109823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9
Sep 25 12:01:52 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:57 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" returned: 0 in 5.793s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:57 devstack cinder-volume[87358]: DEBUG cinder.image.image_utils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 {{(pid=87358) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 12:01:57 devstack cinder-volume[87358]: INFO cinder.image.image_utils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Converted 1024.00 MB image at 176.73 MB/s
Sep 25 12:01:57 devstack cinder-volume[87358]: WARNING cinder.volume.drivers.remotefs [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 is being set with open permissions: ugo+rw
Sep 25 12:01:57 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:57 devstack sudo[109873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9
Sep 25 12:01:57 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:58 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" returned: 0 in 0.239s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" released by "_copy_volume_from_snapshot" :: held 6.922s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" released by "_create_volume_from_snapshot" :: held 6.985s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.003s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95657607-a445-45e1-959e-6756696b0d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9', 'volume_size': 1, 'snapshot_id': '5e0019de-80b4-452b-8a96-8cfcb948dd05'}' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544e440b-af70-4c4e-ba90-7c0431fc07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 12:01:58 devstack cinder-volume[87358]: INFO cinder.volume.flows.manager.create_volume [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Volume volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 (f15d728a-6867-4df5-9b8e-dc0bab8b09e9): created successfully
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544e440b-af70-4c4e-ba90-7c0431fc07f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87358) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Flow 'volume_create_manager' (2bae1c42-2acc-4c73-b77e-e8573ed91c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87358) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 12:01:58 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-96b9c1d1-a80e-48a0-be33-fa5356a05664 tempest-SnapshotDependencyTests-604406127 None] Created volume successfully.
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-5e0019de-80b4-452b-8a96-8cfcb948dd05-delete_snapshot" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-5e0019de-80b4-452b-8a96-8cfcb948dd05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" by "delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05" by "_delete_snapshot" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Deleting offline snapshot 5e0019de-80b4-452b-8a96-8cfcb948dd05 of volume 944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] snapshot_file for this snap is: volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede278a0-2458-4763-9eef-9fbb0ef7171f]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:58 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:58 devstack sudo[109876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:01:58 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:59 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.354s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.remotefs [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944fc063-ef83-4372-a0cc-c612806909ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87358) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9322d6-cff5-409f-bfb8-f7de8422d091]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:59 devstack sudo[109881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:01:59 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:59 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.555s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:01:59 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:01:59 devstack sudo[109886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:01:59 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:01:59 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.364s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:00 devstack sudo[109891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05
Sep 25 12:02:00 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:00 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef.5e0019de-80b4-452b-8a96-8cfcb948dd05" returned: 0 in 0.273s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-5e0019de-80b4-452b-8a96-8cfcb948dd05" released by "_delete_snapshot" :: held 1.647s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" released by "delete_snapshot" :: held 1.669s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Created reservations ['94631e86-158f-4ca8-9404-e559e64e0c75', '089269bf-02cd-47c1-ab09-f9444144b736', 'fa347473-f9f3-4e24-b398-faff41ae323e', 'a2722448-5a33-4001-ada0-e35f9d9cda16'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:02:00 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Delete snapshot completed successfully.
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-f61a37c5-a928-4e40-a53e-3e62c39bd928 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-5e0019de-80b4-452b-8a96-8cfcb948dd05-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-944fc063-ef83-4372-a0cc-c612806909ef-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-944fc063-ef83-4372-a0cc-c612806909ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b8116-9c8e-40fa-b200-11a75820d6bc]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:02:00 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:01 devstack sudo[109894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:02:01 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:01 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.385s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:01 devstack sudo[109899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef
Sep 25 12:02:01 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:01 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-944fc063-ef83-4372-a0cc-c612806909ef" returned: 0 in 0.264s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-944fc063-ef83-4372-a0cc-c612806909ef" released by "delete_volume" :: held 0.713s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Created reservations ['7d441e68-fe7a-42d7-aa13-a974ebc053aa', 'f71ef6ab-986e-4d98-9d21-4b849460dce1', '391dcb37-c49f-41e9-b9f4-ba715b22d117', '6e326967-1c06-486f-a8ea-9a67bb0b8f34'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:01 devstack sudo[109902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:02:01 devstack sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:01 devstack sudo[109902]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-f15d728a-6867-4df5-9b8e-dc0bab8b09e9-delete_volume" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.269s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:01 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:02:02 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Deleted volume successfully.
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-f15d728a-6867-4df5-9b8e-dc0bab8b09e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-8b8843ae-a745-4cc4-8014-01a9e6897985 tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-944fc063-ef83-4372-a0cc-c612806909ef-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" by "delete_volume" {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" acquired by "delete_volume" :: waited 0.017s {{(pid=87358) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c7b2c-d9e7-420c-9ffc-6126b122f1ac]: (4, 'qcow2') {{(pid=88992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:02 devstack sudo[109905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9
Sep 25 12:02:02 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:02 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" returned: 0 in 0.383s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9 {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:02 devstack sudo[109910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9
Sep 25 12:02:02 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:02 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f/volume-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" returned: 0 in 0.272s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-quobyte-f15d728a-6867-4df5-9b8e-dc0bab8b09e9" released by "delete_volume" :: held 0.703s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.quota [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Created reservations ['d9b5c1e6-086a-4035-b60b-329b2f853b7e', '53a556e0-54c0-4072-b101-4436e9ceb5df', '7b2ea61c-75ec-4821-9649-6aadd137bad8', '1468c43b-87a6-49ab-b1e3-e18904eea05f'] {{(pid=87358) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2': None} {{(pid=87358) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG cinder.volume.drivers.quobyte [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a0d0eb8f-4e39-4982-88e8-825635e11fa2'] {{(pid=87358) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.lockutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 12:02:02 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 12:02:02 devstack sudo[109913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f
Sep 25 12:02:02 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 12:02:03 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root
Sep 25 12:02:03 devstack cinder-volume[87358]: DEBUG oslo_concurrency.processutils [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7e0bd7305e2fc53c675572fa99baf2f" returned: 0 in 0.265s {{(pid=87358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 12:02:03 devstack cinder-volume[87358]: DEBUG cinder.manager [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Notifying Schedulers of capabilities ... {{(pid=87358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 12:02:03 devstack cinder-volume[87358]: INFO cinder.volume.manager [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Deleted volume successfully.
Sep 25 12:02:03 devstack cinder-volume[87358]: DEBUG cinder.coordination [None req-ad01ec87-e6bd-49e8-828c-375a0022e84c tempest-SnapshotDependencyTests-604406127 None] Lock "cinder-f15d728a-6867-4df5-9b8e-dc0bab8b09e9-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87358) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 12:02:12 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:INSERT=9 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 12:02:13 devstack cinder-volume[87358]: DEBUG dbcounter [-] [87358] Writing DB stats cinder:UPDATE=26,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}